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Foreword 



High School and Beyond (HS&B) is a large-scale, national longitudinal study designed and sponsored by the 
National Center for Education Statistics (NCES), with support from other governmental agencies. HS&B provides 
a variety of data about 1980 sophomores and seniors as they move through U.S. high schools and into the many 
and varied activities of early adulthood. The study began with the group adminijJitration of questionnaires and tests 
to 30,000 sophomores and 28,000 seniors, including over 500 sets of twins, in more than 1,000 public and private 
schools in spring 1980. In fall 1980, data were collected from over 6,500 of the parents of HS&B participants, 
primarily to inve.stigate questions regarding financial planning for postsecondary education. HS&B has continued 
with a second collection of information from the 1980 sophomores and seniors in spring 1982 and the collection of 
high school transcripts in fall 1982. for a subsample of sophomore cohort members. A third data collection from 
1980 sophomores and seniors took place in spring 1984. 

It is not possible to obtain 100 percent cooperation in a strictly voluntary survey such as HS&B, and those 
who do respond may not always po.ssess accurate information or for other reasons may provide inaccurate answers. 
Good survey practices require the examination of the quality of the data collected. Assessment of data quality leads 
to better analysis and interpretation of the data and improvements in the designs of future studies. Mechanisms for 
examining data quality were buih into the HS&B design. Nonrespon.se bias is considered elsewhere. This report ex- 
amines the quality of responses of high school students to questionnaires that were group administered in a school 
setting. The validity of student responses, in most instances, is judged against the standard of parent responses; and 
reliability is estimated by comparing the responses of the two members of twin data. The validity of student reports 
of grade averages and courses taken is assessed by use of transcript data. Data quality is evaluated as a function of 
item type and the age, sex, race/ethnicity, and other characteristics of the respondents. 

The results of this study will be u.seful in the analysis and interpretation of the data generated by HS&B and 
.similar surveys, and will be helpful in designing student questionnaires for future surveys. 

David A. Sweet, A.ssistant Administrator 
Division of Multilevel Education Statistics 

C. Dennis Carroll, Chief 
l.ongitudinal Studies Branch 
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Executive Summary 



Three features of High School and Beyond (HS&B) provide rare opportunities for examining the quality of 
the responses of high school students to group-administered questionnaires: (1) many identical or similar items also 
were asked in questionnaires completed by about 6,500 of the students' parents; (2) high school transcripts contain- 
ing information about coursework and grades were obtained in fall 1982 for about 16,000 of the 1980 sophomore 
cohort HS&B participants; and (3) questionnaire data were obtained from both members of more than 500 twin 
pairs. The findings of previous investigations of the reliability or validity of survey data obtained from high school 
students are discussed in the report. The results of analyses of the three HS&B data sets are generally quite consis- 
tent with the findings of previous investigations. As indicated below, the quality of student questionnaire data 
depends on both the nature of the questions asked and the characteristics of the student who provides the answers. 

A lag of about 6 months between the collection of data from parents and students and other considerations 
(e.g., inaccuracies in responses of parents) make the standards against which accuracy is judged somewhat fallible. 
Thus, actual quality of student questionnaire data undoubtedly is somewhat higher in many instances than that in- 
dicated in this report. 

A, Validity--Parent Questionnaire Data as Standard. 

1. The quality of HS&B student questionnaire data generally is fairly high for contemporaneous, factual mfor- 
' niation. For example, the validity coefficients* are almost .90 for father's educational attainment and about 

.60 for father's occupation. The validity of the socioeconomic status (SES) composite that often is 
employed in HS&B data analyses was found to be at least .80. 

2. The quality of retrospective information tends to decline with the passage of time; for example, concerning 
whether the mother worked at various times, from about .71 for during high school, to about .64 for dur ng 
elementary school, to .53 for prior to elementary school. 

3. The validity of less factual information tends to be lower; e.g., about .60 for the mother's aspirations for 
her child's education. 

B. Validity— Transcript Data as Standard . 

1 The grade averages reported by seniors correlate well (.77) with grade point averages computed from their 
transcripts. Seniors reported their grades to be somewhat higher (about one-fourth of a letter), however, 
than shown by their transcripts. 

2 The cor.-elation coefficients between senior reports and transcript data are high (in the .80's) for amount ot 
coursework in specific foreign languages and for whether geometry, physics, or chemistry ever was taken. 
The coefficients are somewhat lower, ranging from .63 to .70, for amounts of coursework in mathematics 
and science and for whether 2nd-year algebra, trigonometry, and calculus ever were taken. They are lower 
yet for the two areas (history or social studies and English or literature) that show relatively little variation 
from student to student in amount of coursework taken. Seniors tended to report they had taken more 
coursework in mo-^t areas than reflected by their transcripts. The amount of over-reporting was greatest for 
mathematics (abou' i semester) and science (about Vi semester). 
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C, Reliability. 

Reliability coefficients for responses regarding familial background information, estimated trom twin data, 
tend to be highly correlated with (r- .92) and slightly larger (.05, on the average) than validity coefticients 
estimated by comparing student and parent responses. Reliability coefficients are available for more variables 
than are validity coefficients because many student questionnaire items were not included in the parent ques- 



tionnaire. 

I . The coefficients for some of the major variables of interest that were not ineniioned m preceding sections ot 
the highlights are as follows: 
-whether student was born in U .S. ' (seniors) 

-kindergarten attendance (.opho.nores) 
Tor a discussion* of the concepts of validity, bias, reliabiiiiy. and concistcncy. sec section 2.5 on page I 1 . 
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—when began attending present school 
—student's race/ethnicity 
— number of siblings in high school next fall 
— school racial/ composition, grade 9 
—number of years student lived in U.S. 
— student's age 

— student's religious background 
—number of rooms in home 
—number of siblings in college next fall 



.89 ^seniors) 
.89 (seniors) 
.84 (seniors) 
.83 (seniors) 
.81 (seniors) 
.78 (seniors) 
.78. (seniors) 
.71 (seniors) 
.68 (seniors) 



2. Students also were used as sources of information about their schools with regard to rule enforcement (five 
items), disciplinary problems (six items), and several other matters. The questions asked gene/ally are of a 
highly judgmental nature (e.g., the extent to which "students talk[ing] back to teachers" is a problem). 
Consequently^ most of the reliability coefficients estimated from twin data are only between .20 and .40.* 
While the coefficients for individual items for individual students are not very high, it should be noted that 
(1) many of these items can be combined into composite measures and (2) for many analytical purposes, it is 
appropriate to aggregate the data for many of these items (or composites formed from them) to the school 
level. Composites and school means, of course, have much higher reliability coefficients than those for in- 
dividual items or individual students. (For example, if the reliability of a variable is ,20 for an individual stu- 
dent, the reliability for the mean value of the variable for 36 randomly selected students in the school would 
be about .90.) 

D, Consistency, 

The extent of agreement between parent and child was examined for a number of variables for which the 
parental response could not be taken as a factual standard. Thus for these variables, the extent of agreement 
between parent and child reflects the degree to which they share the same perceptions and is not a measure of 
the quality of student responses. Of particular interest is the high correlation coefficient of .76 found for high 
school giade point average. The correlation coefficients for other variables, however, are lower; e.g., .61 for 
estimated schooling expenses for the coming school year, .07 to .47 for planned use of 13 possible sources for 
paying school and living expenses, ,06 to .25 for estimates of costs of attending various kind of postsecondary 
education institutions, and .11 to .56 for the importance of various factors in choosing a college. 

E. Quality of Data by Student Characteristics, 

The quality of questionnaire responses was found to be better for some groups of students than for others: 

1. Seniors generally provided better quality data than did sophomores. For example, the average validity coef- 
ficient for 12 family background items is .64 for sophomores, .67 for seniors; and the average reliability 
coefficient f or 3 1 family background items is .66 for sophomores and .70 for seniors. With regard to school- 
related variables, the average reliability coefficients are .44 for sophomores and .54 for seniors. 

2. Female students tended to provide slightly better quality data than males. The overall average validity coef- 
ficients are .64 for females and .61 for males for family background items, «and .72 for females and .69 for 
males for high school grades and coursework. 

3. White students provided better quality data than Hispanic or black students. For example, the mean validity 
coefficients for family background items are .61 for whites, .57 for Hispanics» and .54 for blacks; and for 
high school grades, the coefficients are .80, .66, and .65, respectively. Also, Hispanic and black students 
overstated to a greater degree than white students the amount of coursework they had taken in mathematics 
and science. 

4. The quality of questionnaire data varies considerably with cognitive test performance level. From lowe^i to 
highest test score quartile, the mean validity coefficient rises from .56 to .67 for family background items 
and from .47 to .73 for amount of coursework taken. Some student questionnaire and transcript mean 
values also agree less closely for low- than for high-scoring students. The most extreme example is the 
amount of mathematics taken, where the mean calculated from questionnaires exceeds that calculated from 
transcripts by 1 .8 semesters for students in the lowest test score quartile, but by only .6 semester for those in 
the highest quartile. 



• The response, ot twins, however, may agree more closely than would the responses of two randomly selected students m the same school 
because ot the possible mfluence of attitudes and standards that are learned in the common home of twins. 
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Chapter 1 — Introduction 



1.1 Background and Purpose 

The base-year survey of the longitudinal study High School and Beyond (HS&B) took place in spring 1980. 
Data on a variety of topics were obtained by means of questionnaires and tests which were group- 
administered in school to national probability samples of about 30,(XX) high school sophomores and over 
28,000 seniors. Although information is available about the reliability of the HS&B tests (Swineford, 1973; 
Heyns and Hilton, 1982), little information thus far has been available about the accuracy of the question- 
naire data, i 

HS&B provides a rare opportunity to examii.e ftie validity and reliability of questionnaire items completed by 
high school sophomores and seniors. This opportunity arises from three almost unique aspects of the study. 
First, in fall 1980 questionnaire data were collected from a subsample of over 6,500 parents of students who 
participated in HS&B. The major purpose of the parent survey was to garner information about how parents 
plan to finance the postsecondary education of their children. Another purpose, however, was to secure data 
that would enable NCES to assess the validity of student reports about family income, parental education, 
language spoken in the home, and other family and home variables. Second, in fall 1982 the high school 
transcripts of about 16,000 of the 1980 sophomore survey participants were obtained from their schools. The 
transcripts were collected primarily to secure information about course taking patterns and to relate these 
patterns to student and school characteristics and to test performance, college attendance, and other outcome 
measures. They also provide a check, however, on the accuracy of student reports of coursework take,n and 
grades obtained. Finally, special provisions were made in HS&B to identify fhe co-twins of all sampled twins 
and to obtain questionnaire and test data from them. Through these efforts data were obtained from both 
members of about 500 sets of twins. The twin data are useful in providing estimates of the reliability of stu- 
dent reports about their schools as well as about their parents and home backgrounds. 

Family background variables have been demonstrated to be important predictors of a child's educational at- 
tainment and success in school and of intergenerational occupational mobility (Averch et ai, 1971; Borus 
and Nestel, 1973). For this reason, many studies that employ HS&B data attempt to control for family 
background variables. Many analyses of HS&B data also rely heavily on student questionnaire data for 
values of various variables that reflect the student's school performance (e.g., grade average), educational ex- 
periences (e.g., kindergarten attendance and coursework taken), and school context (e.g., racial composition 
of classes in earlier grades, enforcement of rules, and discipline problems). Estimates of the reliability and 
validity of measures of family and school variables obtained from student questionnaires should enhance the 
researcher's ability to properly analyze HS&B data and to correctly interpret the results of the analysis. 

Students were asked a variety of questions about their attitudes, plans, and expectations. It is not poss ble in 
this study to assess the quality of student response to questions of this nature. It is possible, however, to 
determine the extent to which parent and child see eye-to-eye regarding such matters as parental influence on 
student plans, the age at which the child will marry, the occupation the child will enter, the child's ability to 
complete college, attitudes about sex rolts, college costs, and factors important in choosing a college. This 
report includes an analysis of the consistency of student and parent responses on these items. Tliis kind of 
consistency information should provide insights regarding the extent of accurate communication of feelings, 
information, and intentions between generations within the family; and it should give indications of the 
degree of reality of student and parent perceptions of the world and of the child's future. Of special interest is 
the amount of consistency between parent and child perceptions of: (a) how much money the child will need 

I information about the reliability (interrial consistency) of certain psychological and educational scales constructed from sets of questionnaire 
items utilized in HS&B as well as NLS-72, however, may be found in Riccobono et at., 1981. The internal coiiMstciity of ^uch ^calcs is not 
examined in the present report. 



for living and schooling expenses the year after high school; (b) the sources of funds (parents, student sav- 
ings, government financial aid programs) for meeting these expenses; and (c) the importance in college selec- 
tion of the cost and availability of financial aid at the college. Such data should be useful in postsecondary 
education financial aid studies. 

1.2 Findings of Previous Studies 

Several investigations of the quality of student questionnaire data obtained in the National Longitudinal 
Study of the High School Class of 1972 (NLS-72) have been conducted. The report of the results of one of 
these investigations (Conger ei al-, 1976) is particularly valuable since it includes an extensive review and 
discussion o!.' the literature on the validity and reliability of survey questionnaire research. Previous research 
involving NLS-72 and other data bases, however, generally has been more limited than that contained in the 
present report because of sample sizes that were too small to permit subgroup comparisons, restricted scope 
of variables studied, and problems of design and implementation. 

1.2.1 Stability and validity study, 1972 seniors, Echternacht (1973) presented the results of "stability"2 and 
validity studies conducted in conjunction with the NLS-72 base-year survey. Echternacht, based on a re- 
administration of a subset of questionnaire items to a sample of 503 of the 1972 seniors, estimated reliability 
coefficients to be as follows (table 1.1): 

Table LL Estimated reliability coefficients by variable category, base-year NLS-72 student questionnaire. 



Variable category Range of coefficients 



Persons influencing post-high school plans .26 to .43 

Artitudes toward self .22 to .34 

Attitudes toward high school . ,19 to .30 

Life values .34 to ,57 

Future occupation ^ .57 

Career selection values ^ .19 lo .44 

Life's work values .12 to .35 

Educational aspiration and plans .42, .65 

Race-ethnicity .89 



The NLS-72 base-year validity study compared the responses of 391 parents with those of their children (1972 
seniors). Echter nacht examined only the "bias" aspect of validity; that is to say, he analyzed the mean dif- 
ferences between parent and child responses rather than the correlations between the responses from the two 
sources. The bias in student responses was estimated for each category of about a dozen items. About 69 per- 
cent of the bias estimates were less than two percentage points. Some of the largest biases, in terms of the 
statistic he employed, were as follows (table 1.2): 

Table 1.2. Item categories with large estimated biases, base-year NLS-72 student questionnaire 



Item category 



Difference (parent minus 
child) in pet. points 



Length of residence in community = all nis/her life 
English is the language most often spoken in home 
Student has specific place to study 
Home has encyclopedia 

Family income is between $10,000 and $1 1,999 

Famil> income is between $15,000 and $18,000 

Father's occupation -vas clerical 

Father*:, occupation was operative 

Mother^ highest education level = high school graduate 



-7.7 
5.1 

-6.7 
-6.1 

5.0 
-10.4 

8.2 
-5.4 

5.0 



^Ihis Mud> \^as culled a response stability rather than a reliablluy ,tuU> hecausv ot ilie lon^i la^ (rinighK 2 u\on\\\-) hciueen the w,'^ data 
collection dates. I he time lag in.ide it questionable as to wlielher chani^es in responses vsere due to respi)nse iinreliahihu or io actual changes 
in beliefs and attitudes. 

» 2 i 0 
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The key assumption in a validity study of this kind is that parents' responses are better or more accurate than 
students' responses. Echternacht points out that his estimates of bias may have been adversely affected by the 
long lag (approximately 1 year) between student and parent data collections. He also indicates that the low 
parent response rate (74 percent) might have some biasing effect on the estimates. 

1.2.2 Reliability of retrospective data. Lyons and Moore (1976) compared the responses given by a sample 
of 415 subjects in fall 1973 with their initial responses in spring 1972. The time referent for the questions ask- 
ed in fall 1973 was spring 1972. The authors used the proportion of individuals who selected the same 
response in both surveys to measure reliability. This measure yields higher values than the measures o' 
reliability conventionally employed. 

The results of their study are summarized in table 1 .3. For ordinal variables, the statistic shown in table 1 .3 is 
the proportion of responses thai agree to within one category. 

Table 1.3. Proportion of responses In fall 1973 that agreed with Initial responses In spring 1972: 1972 high 
school seniors 

Variable 

(Time referent for all variables is spring 1972) 

Father's, mother's educational attainment level* 
Family yearly income* 
Items in home (11 items) 
Race-ethnicity 
Language background 
Religious background 
Limiting physical condition 
Type of community lived in* 
High school program 
High school grade average* 
Participation in extracurricular activities (9 items) 
Hours worked for pay* 

Father's, mother's educational desires for child* 
When decided whether would go to college* 
Postsecondary plans of close friends 



•Response selections are ordinal. Statistic shown is the proportion of responses that agree to within one category. 

1.2.3 Validity and reliability of survey research questionnaires. Conger et ai (1976) presented the results of 
a test-retest reliability study of a subset of 17 items from the NLS-72 second follow-up survey. Individuals 
who responded to the second follow-up survey by mai. were mailed the short questionnaire containing the 17 
items no earlier than 10 days after the completion date denoted on the second follow-up questionnaire. 
Reliability sample members who responded to the second follow-up survey by personal interview were re- 
interviewed with the short-form questionnaire 2 weeks later. The authors also reviewed the literature (33 
references) on the quality of responses to NLS-type questions; and integrated their findings with those of 
other research. A validity study was not done; but previous research indicated to these authors that validity 
and reliability results generally are in close agreement. Based on the findings of other investigators, as well as 
on their own research, Conger et at. drew several major conclusions; 

A. Reliability and validity as a function of Item characteristics. The literature as well as their own study in- 
dicated that contemporaneous, objective, factually oriented items are more reliable and valid than sub- 
jective, temporally remote, or ambigious items. The NLS-72 second follow-up survey reliability study 
yielded estimated coefficients in the range .67 to .92 for contemporaneous, factually based items and bet- 
ween .36 and .86 for other items. Boruch and Craeger (1972) and van Es and Wilkening (1970) also 
found that items with a future as well as those with a retrospective orientation were less reliable than con- 
temporaneous items. The literature Indicates, however, that even factually oriented items differ in 
reliability depending on the importance (Astin, 1965), with personally important items being more 
reliable, Boruch and Craeger (1972) indicate that personally sensitive items (e.g., income) are less reliable 
than other factually oriented 'terns. Finally, Conger et al. found that attitudinal and psychological 
variables were typically of moderate reliability. 



Agreement 
proportion 

.94, .95 

.65 
.67 - .98 

.95 

.91 

.80 

.91 

.79 

.72 

.93 
.77 - .93 

.70 
.92, .94 

.82 

.64 
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The results of validity studies such as those by Walsh (1967 and 1968) and Kyaser and Summers (1973) 
were similar lo those of reliability studies. 

B. Reliability and validity as a function data collection procedures. The results of the authors' reliability 
study showed that the interview procedure generally producec! more reliable results than did the maiUin 
procedure. Studies by Walsh (1967, 1968) anoi Cannell and Fowler (1963) indicated that neither approach 
is consistently superior. Some important interactions were revealed. In particular, high ability and high 
SES persons were less influenced by data collection procedures than iow ability or low SES persons. The 
latter groups were more cooperative and produced more accurate data in the interview procedure. 



Previous researchers found a content by data collection procedures interaction. Questions which could 
be answered by consulting records were more accurately answered in a mail-in procedure. 

C. Reliability as a function of respondent characteristic^. Validity studies indicate that: (a) blacks provide 
less accurate information than whites (Borus and Nestel, 1971; Kerckhoff. Mason, and Poss, 1973; and 
Cohen and Orum, 1972); (b) low SES respondents furnish less accurate data than do high SES 
respondents (Borus and Nestel, 1971; Cohen and Orum. 1972; and Walsh and Burkhold, 1970); (c) 
students with higher grades produce more valid data than their counterparts (Boruch and Craeger, 1972; 
and Borus and Nestel, 1971); and (d) no clear edge exists for either males or females, but males tend to 
produce higher quality data on financial or numerical questions. The NLS-72 second follow-up survey 
reliability study results were in general agreement with these validity study findings with one major ex- 
ception. The reliability study indicated a balanced set of racial differences with a tendency for minority 
youth to have higher reliability coefficients than whites. 



1.3.1 Twin component of student survey. The HS&B base-year survey employed a two stage stratified sanv 
pie. Public and private schools were stratified according to several key variables, and then schools within each 
stratum were selected with probabilities proportional to estimated average grade 10 and/^r grade 12 enroll- 
ment. Certain types of schools were oversampled. In the second stage of the sample, simple random samples 
of 36 sophomores and 36 seniors, school size permitting, were cho.sen from each selected school. Detailed in« 
formation about the basic HS&B sample design may be found in Frankel et at, (1981). Information about 
field procedures may be found in the student file user's manual (NORC, 1980); and some of the base-year 
survey results are described in a report by Peng et al. (1981). 

Many researchers believe that twin data lend themselves to powerful analyses which enhance the utility c» 
data from fhe overall study. Therefore, efforts were made to identify twins that had been among the cluster 
of 36 randomly chosen students. If the co-twin of a twin selected to participate in the survey attended the 
same high school and had not been already randomly selected into the sample, the co-twin was asked to take 
part in the survey. As a result of these efforts, questionnaires we.^e completed by both members of the 276 
sophomore and 235 senior twin sets. 3 The procedures used to identify twins and augment the sample by add- 
ing non-sampled co-twins are described more fully in the twin and sibling file user\s manual (NCE:S» 1982). 

1.3.2 Parent sun-ey. A random sample of 3 12 of the schools that fully participated in HS&B was choosen for 
the parent survey. ^ in each parent survey school, simple random samples of 12 sophomores and 12 seniors 
were selected from those students who had completed HS&B questionnaires and taken the HS&B tests. A 
total of 3,654 sophomores and 3,547 seniors were selected by the procedures described in the parent question- 
naire codebook (NORC, 1981). 

The contractor attempted to collect data from the parents of these students by a combination of mailcd-out 
questionnaires, telephone interviews, and personal interviews. All questionnaires were mailed to parents by 
October 10, 1980. Data collection ended December 31. 1980. A response rate of 91 percent was achieved; 
3,367 forms were comleted by parents of sophomores and 3, 197 by parents of seniors. Mothers filled in about 
60 percent of the questionnaires, fathers about 35 percent, and other adults (stepparents, grandparents, etc) 
the remaining 5 percent (table 1.4). 



^These numbers exclude five sophomore and three senioi twm seis where ofie >iudeni gave a ncgaiive response to the question. "Do >ou h;ue a 
twin brother or a twin sister?" 
'^A school participated fully if it pei nutted tests as well as questionnaires to be administered. 
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Table 1.4. Relationship of parent quesUonnaire respondents to student; 1980 sophomores and seniors 



Respondent 


Sophomores 


Seniors 


Number 


Percent 


Number 


I Percent 


Total 


3,367 


100.0 


3,197 


lUU.U 


Mother 


2,047 


60.8 


1,867 


58.4 


Stepmother 


30 


0.9 


31 


1.0 


Father 


1,157 


34.4 


1.152 


36.0 


Stepfather 


38 


1.1 


32 


1.0 


Grandmother 


26 


0.8 


30 


0.9 


Grandfather 


7 


0.2 


4 


0.1 


Other relative or guardian 


56 


1.7 


74 


2.3 


Unclcissiried 


6 


0.2 


7 


0.2 



* details may not sum to SOO.O due to rounding. 

The composition of the realized parent survey sample by sex of student, student composite test score, family 
SES level (student-reported), and student racial/ethnic category is given in table 1.5. Note that the sample 
sizes are large enough for Hispanics and blacks to support the calculation of separate estimates of validity 
and consistency coefficients for each minority group for each cohort, 

L3J Transcript study* The sample for the transcript study consists of 18,152 selections from the 1980 
sophomores who were eligible to participate in the fust follow-up survey of HS&B.5 Students who liad at- 
tended private schools, high school dropouts, minority group students, and other segments of the population 
of special concern to education policymakers were heavily oversampled. 

Table 1.5. ComposUion cf parent survey realized sample by selected student characteristics: 19M 



Respondent characteristics 


Sophomores 


Seniors 


Number 


Percent 


Number 


Percent 


Total 


3,367 


100.0* 


3,197 


100.0 


Sex of student: 










Male 


1,527 


45.4 


1,404 


43.9 


Female 


1,649 


49.0 


1,690 


52.9 


Unclassified 


191 


5.7 


103 


3.2 


Student test score Quartile: 








28.1 


Lowest 


908 


27.0 


898 


Second 


825 


24.5 


780 


24.4 


Third 


793 


23.6 


764 


23.9 


Highest 


838 


24.9 


753 


23.6 


Unclassified 


3 


0.0 


2 


0.0 


SocioecoT. )mic status (student-report'^d): 






972 


30.4 


Lowest 


881 


26.2 


Middle two 


1,590 


47.2 


1,452 


45.4 


Highest 


745 


22.1 


709 


22.2 


Unclassified 


151 


4.5 


64 


2.0 


Race/ethnicity of studeni: 










Hispanic 


350 


10.4 


298 


9.3 


Black 


470 


14.0 


395 


12.4 


White 


2,376 


70.6 


2,236 


69.9 


Other 


113 


3.4 


143 


4.5 


Unclassified 


58 


1.7 


125 


3.9 



•Details may not sum to 100.0 due to rounding. 



5This sample was augmented by the addition of 275 non-sampled co-twins. 



ERIC 



5 

ij 



Transcripts were provided by high schools in fall 1982 for 15,941 (88 percent) of the 18,152 individuals for 
whom they were requested. Courses were assigned a six-digit classification code based on a taxonomy 
developed by Evaluation Technologies Incorporated for NCES,6 and course grades were coded by NORC so 
as to be on a uniform scale regardless of the school's grading system. 7 

The investigation of the quality of studeni questionnaire responses utilizes transcripts only for those students 
who were still attending high school in spring 1982. The composition of this subset of the realized sample of 
transcripts is shown in table 1.6. The sample sizes are large enough to obtain very accurate estimates of the 
quality of data provided by subgroups of str.dents, including Hispanics and blacks. 

Table 1.6. Composition of transcript study realized sample by selected student characteristics: 1980 
sophomores attending high school in 1982 



Student characteristics 



Total 

Sex: 
Male 
Female 
Unclassified 



Number 



13,173 

6,545 
6,628 
0 



Percent 



100.0 

49.7 
50.3 
0.0 



Test score quartile (1980): 
Lowest 
Second 
Third 
Highest 
Unclassified 



2,324 
2,695 
2,890 
3.434 
1,830 



17.6 
20.5 
21.9 
26.1 
13.9 



Socioeconomic status (SES) quartile (1980): 
Lowest 
Middle two 
Highest 
Unclassified 



2,829 
5,615 
3,246 
1,483 



21.5 
42.6 
24.6 
11.3 



Race/ethnicity: 
White 
Hispanics 
Black 
Others 
Unclassified 



8,049 
2,692 
1,779 
536 

117 



61.1 
20.4 
13.5 
4.1 
0.9 



^Ludwig ei al., 1982. 
"^iontiet al., 1983. 
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Chapter 2 — Methodology 



2.1 Variables Analyzed 

Table 2.1 lists the variables analyzed in the parent-child portion of this study. The variables are grouped into 
two broad categories. The first contains variables that are factual in nature and for which the parent's 
response provides a standard for judging the accuracy of the student's response. The second category in- 
cludes all other variables. For simplicity, the first category is labeled "validity (p.ifent-referent)," the second 
"consistency. "8 The distinction between these categories may be blurred for some variables. It is not always 
entirely clear whether the parental response provides a sound factual standard, especially where an element of 
judgement is involved. While of conceptual importance, the distinction has little bearing on how the data are 
analyzed. Both validity and consistency are measured in the same way— by the degree of correlation between 
parent and child responses. 

Table 2.2 lists the variables that were included in the reliability (twin/co-twin) portion of this study. Many 
more variables could be analyzed in the reliability portion of the study than in the validity and consistency 
components. The variables were divided into two categories, home/family and school. 

Transcript data were employed to determine the validity >f student responses regarding high school grade 
average, number of semesters of coursework taken in each of seven areas, and whether each of six courr.es 
had ever been taken. 

2.2 Treatment of Data 

Cases were omitted from the analysis whenever data were missing due to instrument or item nonresponse or 
were reported in an invalid way for one or both of the two sources being compared. Cases also were omitted 
from the analysis whenever at least one member of a child-parent or twin/co-twin pair answered "don't 
know" or "not applicable" to a variable otherwise measured on an ordinal scale. For the question concernmg 
the age at which the student expects to (or is expected to) get married, have first child, etc., cases with "don't 
expect to do this" responses by the child, parent or both also were omitted from the analysis.9 

Both members of the twin pairs answered exactly the same questions. The format and wording of some of the 
items in the parent questionnaire, however, differed from that for corresponding items answered by students. 
The general strategy employed where this occurred was to try to map or transform parent responses into the 
student questionnaire format since it is the quality of student responses that is being assessed. The two most 
pronounced instances of this nature ire the parental occupations and family income questions. Parents wrote 
in the names of occupations, which were assigned three-digit Census occupational classification codes by the 
National Opinion Research Center (NORC). The three-digit codes then were matched by NORC to the 16 oc- 
cupational categories listed in the ques/.onnaire answered by students. Income information was obtained 
from parents by having them write in code letters corresponding to 19 class intervals ranging from none to 
$500,000 or more. The midpoints of the designated class intervals were summed for four items: respondent's 
wage/salary income, respondent's business/farm income, spouse's wage/salary income, and spouse's 
business/farm income. The sums then were mapped into the seven family income class intervals given in the 
questionnaire answered by students. 



ftActually. however, for one of the variables in the consistency category (namely, mother's aspira-ions tor child's education) the mother's 
response can be considered to provide a standard for assessing the quality of the student's response. 

^•hc percentage of parents who gave this answer was 2 percent or less for each sub-item. For students, the percentages who gave this answer 
ranged fror 2 percent for "first job" and "live in own home" to 10 percent for "have first child." 
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l able 2.1. Queslionnairt* item numbers of variables analyzed in study of validity of student rei'ponses and 



consistency of parent-cliild responses: 19hC sophomores and seniors* 



Variable 


Questionnaire item number 


Sophomores 


Seniors 


Student 


Parent 


Student 


Parent 


A. vaiiaiiy (parent reierenij 










Items in home (8 items) 


103 

1 V/iJ 


59 


N/A 


N/A 


ivioiner s euucauon 


42 


29/44 


42 


38/50 


rainer s caucaiion 


39 


29/44 


39 


38/50 


Mother's occupation 


41 


38/46 


41 


47/5.') 


Father's occupation 


38 


38/46 


38 


47/53 


r-amily income 


100 


65/66 


101 


70/71 


Own/rent home 


101 


60 


102 


64 


iiome idngudge \^ iLcmb;i 


14/15 


57/58 


14/15 


62/63 


.NnniDer oi siuungs {/. iienisj 


N/A 


M/A 


98/99 


60 


Mother worked during various 










periods (3 items) 


37 


50 


37 


55 


Race/ethnicity 


90/91 


56 


89/90 


61 


B. Consistency 










rilgn scnool grace average 


7 


*j 


7 


3 


Mother's influence on plans 


N/A 


N/A 


49 


16/54 


Father's influence on plans 


N/A 


N/A 


49 


16/54 


Age student expects to ... (5 items) 


78 


14 


81 


19 


atuaent s jod piany 


68 


8 


62 


8 


Student's college plans (4 items) 


72 


9 


68 


9 


Mother's aspirations for 










child's education 


70 


5 


66 


5 


Ability to complete college 


73 


10 


69 


10 


Sex role attitudes (3 items) 


63 




N/A 


N/A 


Estimated living expenses 


N/A 


N/A 


76 


12 


Source of money for expenses 










(13 items) 


N/A 


N/A 


79 


15 


tstimated cost of postsecondary 










education (3 items) 


111 


20 


111 


24 


College choice factors (7 items) 


N/A 


N/A 


116 


37 



***N/A *!,iilk'aiCN thai the item did not appear in both student and parent questionnaires. 

1 lie questionnaires employed in the surveys are not reproduced in this report, but copies of them arc available upon request from NC£S. 
^-Student item numbers refer to the Student Identification Pages (language file). 

In order lo assess the quality of student questionnaire reports regarding high school grade averages and 
coursework, corresponding statistics had to be calculated for each student from the detailed information in 
the transcript file. Information about how this was done is given in section 3.2 of this report. 

2.3 Sample Sizes 

The numbers of observations upon which the estimates of child-parent correlation coefficients were based arc 
given in tables A- 1 , A-7, and A-9. For most variables, the numbers are quite high, ranging up to 95 percent of 
the maximum possible (viz., 3,367 for sophomores and 3,197 for seniors). Table 2.3 lists the variables for 
which the number of cases used in the child-parent calculations fell below 80 percent of the maximum. When 




t) 



data for a child-pareni pair were not usable, it generally was because the student gave a response such as 
"don't know" or did not answer the question at all.io.n 



Table 2.2. Questionnaire items cncluded in reliability study: 1980 sophomores and seniors* 



Variable 



Questionnaire item no. 



Sophomores 



Seniors 



Home/family variables; 
Father/mother lives in same household (2 items) 
Mother worked (3 items) 
Father's job category 
Father's education 
Years father has lived in U.S. 
Mother's job category 
Mother's education 
Years mother has lived in U.S. 
Whether student was born in U.S. 
Years student has lived in U.S. 
Student's age 
Racial/ethnic group 
Race 

Religious background 

Family income (one-thirds) 

Family income (one-.sevenths) 

Family owns/rent house or apartment 

Number of rooms in honu; 

Items in home (9 items) 

Number of siblings in college next fall 

Number of siblings in high school next fall 

School variables: 
Number of school changes due to family moving 
When began attending this school 
Whether attended kingergarten 
Instruction methods used in school courses (6 items) 
School disciplinary problems (6 items) 
Enforcement of school rules (5 items) 
School ratings (8 items) 

Whether school has minimum competency tests 
School factors that interferred with education (5 items) 
Number of black students in classes (3 items) 
Number of Hispanic students in classes (3 items) 



36 
37 
38 
39 
40 
4\ 
42 
43 
44 
45 
85 
90/91 
90 
92 
99 
100 
101 
102 
103 



11 

12 

19 
20 
57 
58 

104 
105 



36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
84 
89/90 
89 
91 
100 
101 
102 
103 
104 
98 
99 



10 
3 



53 
54 
52 
105 
106 



•The questionnaires employed in the surveys are not reproduced in this report, but copies of them are available upon request from NCHS. 

The subset of students who got to an item and felt they had enough knowledge to answer the question in a 
specific way, probably provided better quality data than the other students. Hence, the estimated validity and 



Oa major reason why students did not answer certain questions is that some students did not have sufficient lime to complete the questionnaire. 
The sophomore (senioi ) questionnaire had 1 14 (115) items to be answered by all students. About 96 percent |97 percent) of the sophomores 
(seniors) got as far as item 80. but only about 87 (89 percent) made it all the way to item 1 14 (115). 

'in three instances which are not listed in table 2.3. the number of observations utilized in the computations was constrained by other con- 
siderations: (a) ihe analysis of the items regarding estimated cost of schooling and college choice factors was limited to those cases where the 
seniors indicated possible college aitendance and the parents reported school aitendance by the child— about 2.00() usable cases; (b) the 
analysis of the items regarding the mcither's aspirations for her child's education was restricted to cases where the mother was the parent 
questionnaire respondent • about 1.600 usable cases for the sophomore cohort. 1.550 for the senior cohort: (c) the analysis of the language 
background items was limited to instances where the students provided some evidence of a foreign language background— about 600 usable 
cases for each cohort; and (d) the analysis of items about whether the mother had a job at various times in the past was restricted to those 
cases (about 2.100 sophomores and i.900 seniors) where a female answered the parent questionnaire. 
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consistency coefficients for vaiiables with high percentages of unusable cases may present a somewhat rosier 
picture than is warranted. 



T^ble 2J. Proportion of total cases used in child«parent analysis for variables for which the proportion was 
less than .80 of the maximum number of cases for either cohort 



Cohort 



Variable 


Sophomore 


Seniors 


Mother's education 


.78 


.85 


Father's education 


.63 


.70 


Mother's occupation 


.57 


.62 


Father's occupation 


.66 


.68 


Family income 


.79 


.83 


Father's influence on plans 




.74 


Age expect to ... (5 items) 


.61 to .82 


.56 to .82 


College expectations in earlier grades (3 items) 


.65 to .78 


.69 to .75 


Sources of money for living expenses (13 items) 




.60 to .76 



The proportion of the 276 (235) sophomore (senior) twin file cases utilized in the reliability portion of this 
study exceds .80 for 63 of the 72 items analyzed (table 2,2). The 9 exceptions are identified in table 2.4. 

Missing data is not a problem for high school grades and coursework. All validity estimates made in the por- 
tion of the study employing transcripts are based on at least 90 percent of the maximum of 13,173 cases. 

Table 2.4. Proportion of total cases used in twin analysis for variables for which the proportion was less than 
•80 of the maximum number of cases for either cohort 



Variable 



Cohort 



Sophomore 



Seniors 



Father's education 

Mother's education 

Family income (one-thirds) 

Family income (one-sevenths) 

Mother worked before elementary school 

Hispanic students in grades 1, 6, and 9 

Electric dishwasher 



.51 
.64 
,69 
,72 
.73 
,76 to .77 
,78 



.68 
.80 
.77 

,80 
.77 
,82 to . 
.86 



86 



2.4 Subgroup Comparisons 

When possible, separate estimates of reliability, validity, and consistency coefficients were calculated for 
each cohort. 12 Older students should be better informed than younger ones about such matters as parental 
education and family income; and it was anticipated that high school seniors would have firmed-up their 
plans and attitudes and be more realistic about them. Hence, the degree of consistency between data for 
students and their parents should be greater for seniors than for sophomores. 

For each cohort, validity and consistency coefficients were estimated for subgroups of students. These 
subgroups were formed by classifying students by sex, race/ethnicity (student's report), achievement level 
(measured by their composite scores on HS&B verbal and quantitative tests), and parental socioeconomic 
status (SES) level (student's report). Based on previous research findings, it was hypothesized that for most 
variables, data quality would be higher for white than for minority-group students, higher for high- than for 
low-achieving students, and higher for high- than for low-SES students. In addition, separate estimates of 
validity and consistency coefficients were made on the basis of whether the father (or another male) or the 
mother (or another female) completed the parent survey form. It was expected that for some variables, such 
as mother's education level and sex role attitudes, there would be closer agreement between mother-child 

J^Thc transcript study was limited to the 1980 sophomore cohort. 
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than father-child responses; while for family income, father's occupation, and some other variables, it was 
thought that there would be better father-child than mother-child agreement. 

5 Measurement of Validity, Bias, Reliability and Consistency 

Psychologists commonly use the term validity coefficient to refer to the correlation between the observed 
variable and the construct or true score (Werts, 1974). Although information provided by parents about 
home and family background variables is not infallible, parent responses are assumed to be much more ac- 
curate than those of their children; and parent responses on such matters are the standard against which the 
validity of student responses are judged in this report. The correlation coefficient between parent and child 
responses, however, undoubtedly somewhat understates the validity of student responses. This is due to the 
fallibility of parent responses and the lag of about 6 months between the collection of data from parents and 
Students. 

Fallibility of the standard would seem to be less of a problem when judging the quality of student responses 
against high school transcript data. Nevertheless, there is a certain amount of judgment involved in classify- 
ing and coding some courses; and inter-coder reliability is not perfect. Moreover, in mapping transcript data 
into the course categories in the student questionnaire, there is some ambiguity. For example, if the student is 
asked whether he or she has 'ver taken trigonometry, it is not entirely clear how the accuracy of the student's 
answer should be judged if the student took a unified mathematics course that included a trigonometry com- 
ponent but did not take a separate course in trigonometry. 13 For reasons such as these, this study's estimates 
of the validity of student reports about grades and coursework also should be considered as lower bounds on 
the actual validity of student responses. 

The concept of "bias" also plays a role in the assessment of the accuracy of student responses. Bias is 
measured by the difference in means between student responses and those obtained from the standard (parent 
or transcript) while validity is measured by the correlation in responses from the two sources. Thus the total 
error of student reports of parental income, for example, may be thought of as the root mean square of the 
sums of two components: the variable error as measured by the correlation coefficient and the square of the 
systematic error or bias in student reports (Kish, 1965). 

Reliability is determined by the consistency of repeated independent measurement of a fixed value with the 
same instrument. A traditional test theorist considers the correlation between equivalent, parallel, or alter- 
nate forms of a test to be the reliability coefficient (Werts, 1974). Most investigations of the reliability of 
questionnaire responses have used the "test-retest" approach (Conger, 1976). The expected value of the 
response is a.ssumed to be the same at both repetitions. The farther apart the two repetitions are spaced in 
time, however, the more likely that a difference between the two responses reflects true change rather than 
unreliability. On the other hand, the closer together the two administrations of the instrument, the more like- 
ly the respondent is to recall and therefore repeat the previous response. The former situation results in an 
underestimation of response reliability, the latter results in an over-estimation. 

The correlation between lesponses of twins who were administered questionnaires at the same session should 
be a better estimate of the reliability of certain items than the estimate resulting from the test-retest approach. 
The test-retest approach, on the other hand, provides reliability estimates for attitudinal variables while the 
approach utilizing twin data does not. The twin data are employed in this study to estimate the reliability 
coefficients for home and family background variables and certain present and past school experiences. All 
twin pairs were attending the same school and living in the same household in spring 1980. The estimates of 
reliability coefficients assume, for some variables, that both members of the pair shared common school ex- 
periences (e.g., kindergarten attendance) and home experiences at earlier stages of their lives as weU. 
Estimated coefficients also are presented for a few school variables (e.g., instructional methods used in 
courses taken) for which the true value might not always be the same for both members of the twin pair. For 
these variables, the correlation between twin re.spones sets a lower bound for the reliability coefficient. 

Finally, we have taken the opportunity to examine the consistency or congruence between parent and child on 
certain attitudinal variables (e.g., factors important in choosing a college). I he extent of agreement between 
parent and child reflects neither the validity nor the reliability of student responses. It simply indicates the ex- 
tent to which parent and child see eye-to-eye on such matters. 



1 this suul>. milIi siiukTi's mUfiil lu luui- taken triiioiiomciry. 



11 



The student questionnaire employed only closed-ended items. Respondents were not asked to write in 
numerical values or other kinds of answers, but to mark one of several mutually exclusive, exhaustive 
response categories. Imprecise, but rank-orderable, quantifying words frequently were used to define the 
categories (e.g., agree strongly, agree, disagree, and disagree strongly). In instances where response categories 
were defined quantitatively (e.g., family income ca? ^gories), at least one category had an open-ended interval 
(e.g., family income of $38,000 or more). Thus all measurements were on a nominal or ordinal scale, even 
though the underlying variable often was continuous. 

It should be noted that our analysis examined the overall relationships of the patterns of responses of the stu- 
dent and the standard, and did not attempt to examine the extent of association at the extremes or at vu. ^ .as 
other points of the distributions. For example, it presents the correlation between parent and child for th . en- 
tire range of educational attainment levels of the father. The full distribution is not decomposed vi;;i a 
separate measure of association calculated for various dichotomies, such as advanced degree v U other 
levels. The complete percentage distributions are tabulated, however, and are discussed in the secti ns of the 
report that deal with the topic of bias. The discussion of bias, of course, concentrates mainly on differences 
between the means of the distributions for the students and the parents (or transcripts). 

The same measures of association were used for measuring reliabiirty and the correlational aspect of validity 
and consistency. For variables measured on a fuUy-ordered scale (e.g., family income and number of 
siblings), Pearson's product-mon.ent correlation coefficient (r) was employed. For variables measured on a 
nominal scale (e.g., race/ethnicity and religious background), the statistic called Cramer's V was employed 
(Kendall & Stuart, 1979; Bishop ei al,, 1975). Like r, V can reach a maximum value of i; and for 
dichotomous variables, V equals r. Bias was measured by the difference in mean, or proportions. 
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Chapter 3 — Findings 
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This chapter is organized into three major sections based on classification of variables into three categories: 
family background variables, school variables, and all other variables. 

In section 3.1, student questionnaire responses to family background variables are examined carefully- 
first, with regard to validity and bias using parent data as the standard and then, with regard to reliability using the 
twin file. Next, the relation between reliability and validity coefficients is investigated for variables for which both 
kinds of coefficients were obtained. The quality of family background data provided by seniors then is contrasted 
with that furnished by sophomores; and the validity of questionnaire responses is compared for subgroups of 
students which were formed by classifying cases by whether a male or female answered the parent questionnaire 
and by the student's sex, race/ethnicity, cognitive test performance level, and socioeconomic status (SES). Detailed 
tabulations of validity, bias, and reliability coefficients for family background items may be found in appendix 
tables A.l, A. 2, and A. 3, rei'pectively. 

The investigation in sec'.ion 3.2 of the quality of data about school-related variables has two major compo- 
nents. The first involves estimating the accuracy of senior reports of high school grades and coursework by com- 
paring student reports with values derived from their transcripts. The second involves estimating the reliability of a 
variety of variables by comparing responses of twins. The transcript sample size is sufficiently large to provide ac- 
curate estimates of data quality for various subgroups of students, but the twin sample is not. Validity coefficients 
are presented in table A.4, bias values in table A. 5, and reliability coefficients in table A.6. 

Finally, in section 3.3 the consistency of parent and student responses to a variety of variabler is investi- 
gated, as is the mean difference in responses from the two sources. For these variables, with one exception, 
the parent's respo.ise cannot be taken as a standard for judging the accuracy of the child's response. The 
analysis in this section merely indicates the extent to which the parent's views conform with those of the child. 
Comparisons of parent-child consistency coefficients are made for the same subgroups employed in section 
3.1. Consistency coefficients and mean difference values for grade-point average and variables involving at- 
titudes and expectations are given in tables A.7 and A.8; similar coefficients for variables involving financial 
and college matters are presented in tables A. 9 and A. 10. 

Table A. 11 contains approximate values of standard errors for the estimated correlation coefficients 
presented in prior appendix A tables and in the tables in this chapter. Tables A. 12 and A. 13 give approximate 
standard errors for bias estimates. 

3.1 Family Background Variables 

3.1.1 Validity— parent as standard. Estimated validity coefficients for student responses to family 
background questionnaire items cover a wide range of value.., roughly from .20 to .90 (table 3.1). 

The validity coefficients for student reports of the educational attainment levels of their parents are quite 
high (.80 to .90). These coefficients, of course, apply only to the subset of students who felt they knew the 
answers to the questions. i-* 

The validity coefficients for father's occupation (.57 and .61). mother's occupation (.44 and .45), and family 
income (.50 and .59) are of modest size. The family income questions asked students, however, differed con- 
siderably from those asked parents (section 2.2); and the results of the reliability study, which are presented 
later (section 3.1.3), would seem to indicate that, as a consequence, family income validity coefficients may 
have been substantially underestimated here. 

All 4 items with coefficients less than .40 and 7 of the 15 with values less than .70, are "household posses- 
sions" items. These items were not intended to be used individually, but to be employed, along with the 
"typewriter" and "electric dishwasher" items, in a household possessions composite. The coefficient for this 
composite was not calculated, but it should be higher than the average value of the component items. 



14|n the base-year survey of HS&B. 18 percent of the sophomores and 1 1 percent of the seniors responded "don't knoW to the questiDn about 
their father's education. Vut mother's education, the number of "don't know" responses was almost as high. 17 percent for sophomores 
and 10 percent for seniors. 
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Table 3.1. Estimated validity coefficients for 1980 sophomore and senior responses to family background 
questionnaire items 



Variable 



Validity coefficient 



Sophomores 



Seniors 



High coefficients (.71 to .90): 
Father's, mother's education level 
Electric dishwasher in home 
Siblings in high school next fall 
Socioeconomic status (SES) composite 
Race/ethnicity* 

Language usually spoken in home** 

Mother had job when child was in high school! 

Moderate coefficients (.50 to .70): 
Typewriter in home 

Mother had job when child was in elementary schoolf 
Two or more cars or trucks that run 
Own or rent house or apartment 
Daily newspaper in home 

Mother had job before child was in elementary schoolf 
Other language usually spoken in home** 
Family yearly income 

Low coefficients (.20 to .49): 
Mother's occupation 
Pocket calculator in home 
More than 50 books in home 
Encyclopedia, other reference books in home 
Specific place to study in home 



.87, .81 
.85 

.80 
.78 
.74 
.70 

.63 
.62 
.57 
.56 
.54 
.53 
.50 
.50 

.44 
.39 
.35 
.35 

.21 



.89, .85 

.85 

.79 
.78 
.72 

.65 

.58 

.53 
.61 
.59 

.45 



•This is not truly a validity coefficient since parents were asked to identify their own race/ethnicity, noi that of their child. 
••Analysis includes only students who indicated they had some foreign language background. 
tAnalysis includes only those cases where a female answered the parent questionnaire. 
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The socioeconomic status (SES) composite is an equally weighted average of the household possessions com- 
posite and four other variables: father's occupation, father*s education, mother's education, and family in- 
come. Since the composite was computed for every student who provided data for at least two of the five 
components, SES composite values are available for about 95 percent of all base-year HS&B participants. 
This composite has been widely used since it sums up a number of aspects of the student's background in one 
statistic and has a value (i.e., is not missing) for nearly all cases. Thus, it is encouraging that the validity coef- 
ficient for the composite is .80 for sophomores and undoubtedly somewhat higher (probably about .84) for 
seniors. 15 

Validity coefficients for seniors for variables that do not enter into SES composite calculations are as follows: 
(a) .85 for number of siblings in high school next fall;i6 (b) .79 for race/ethnicity; (c) .78 for language usually 
spoken in home and ,60 for other language spoken in home; (d) .58 for whether home or apartment is owned 
or rented; and (e) about .72, .65, and .53 for whether the mother worked full-time, part-time, or not at all 
during three time periods ranging from high school to before elementary school. i'^ 

I he results of subgroup comparisons are summarized in table 3.2 and are further illustrated in figure 1. 
Figure 1 A contrasts the coefficients for seniors with those for sophomores. A point above the line indicates 
that the coefficient for seniojS is larger than the one for sophomores for the same variable. Figures 1B !F 



l^A^i will be seen in the following paragraph and subsequent section.s. seniors consistently provided more valid and reliable data than 
sophomores. 

1^ The coefficient for number of siblings in college is only .60; but this is an underestimate because the corresponding parent questionnaire item 
refers to all children, not just to siblings of the HS&B students and includes all post.sccondary institutions, not just colleges. 
See footnotes to table 3.1. 



5. Page 14, Table 3.1 , middle section. Insert the twu lines g 2 

"Father's occupation .57 .61" 



*'Siblings in college nexl fall - -60" 



contrast the validity coefficients for subgroups of students defined by the student's sex, race, test perfor- 
mance, and SES and by the parent questionnaire r spondent's sex. Data for both sophomores and seniors, 
identified by different symbols, are plotted in figures IB-IF. 

In most instances, but not all, subgroups were found to differ in the ways hypothesized (section 2.4). 

Cohort. As expected, seniors provided more valid family background data than did sophomores. 18 It can 
be seen from figure lA that all points are above or on the straight line. Thus, for all 12 variables for 
which data are available for both cohorts, the estimated coefficient for seniors is at least as high as the 
corresponding one for sophomores. The average coefficient is .635 for sophomores and .671 for seniors. 

Table 3.2. Mean validity coefficients for family background variables for subgroups of 1980 sophomores and 
seniors, by selected student and parent characteristics 



Subgroup 


No. of 
coefficients 
averaged 


Mean 
validity 
coefficient 


Cohort: 
Sophomore 
Senior 


17 
12 


.635 
.671 


Sex of students: 
Male 
Female 


35 
35 


.613 
.639 


Race-ethnicity of students: 
White 
Hispanic 
Black 


29 
29 
29 


.612 
.570 
.544 


Cognitive test performance: 
Lowest quartile 
Highest quartile 


35 
35 


.562 

.669 


Socioeconomic status: 
Lowest quartile 
Highest quartile 


34 
34 


.547 
.588 


Sex of parent questionnaire respondents: 
Female 
Male 


29 
29 


.612 
.635 



Sex. Perhaps surprisingly, 19 female students furnished more valid responses to questionnaire items con- 
cerning family background than did male students (figure IB). The difference in mean values is small 
(.639-.613 = .026), but highly significant from a statistical point of view (table 3.3). 

Academic ability. Students who performed well academically, as measured by scores on the HS&B 
cognitive tests, answered questions about family background matters in a much more valid way than did 
students who performed poorly (figure ID). The difference in mean coefficients is substantial (.669- .562 
= .107). 

Socioeconomic status (SES). The results by SES composite (figure IE) are mixed. For many variables, 
especially parental education level, the validity coefficients are higher for high- than for low-SES 
students; but for other variables, most notably family income, the coefficients are higher for low- than 
for high-SES students. Because many of the family background variables enter directly into the calcula- 
tion of the SES composite, however, it is difficult to attach much meaning to comparisons based on SES 
level. 



18 Sec table 3.3 for results of statistical tests of significance. 

19 Botuch and Creager (1973) found no male male difference in validity and Cohen and Drum (1972) found that neither sex produced 
sistently superior data. 
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Figure 1.- Estimated validity coefficients for student responses to family background questionnaire 
items: 1980 sophomores and seniors* 



A. Seniors viK^ sophomores B. Females vs. male students C Black vs. white students 




Validity coeHicient Sophomores Validity coeHicie-it Mdi« students VaWity coeffjcient White students 



D. High vs. iow test score students E. High vs. low SES students F. Father vs. mother referent 



r 




•See tables 3 3 and A 1. 



Table 3.3. Results of statistical tests of significance comparing subgroups with regard to validity, reliability, 
and consistency of questionnaire data and comparing validity with reliability coefficients: 1980 



Consistency— Financial and college items 

7A. Female vs. male students 28 

7B. Black vs. white students 28 

7C. High vs. low test score 28 

7D. High vs. low SES students 28 

7E. Father-child vs. mother-child 28 



19 
5 
22 
20 
21 



8 

23 

8 
6 



1 

0 
1 

0 

1 







Sign test a/ 


Figure number 
and comparison group 
(Groups with signi- 
ficantly higher ^ 
coefficients in italic) 


Sample 
size 


Number of coefficients 
relative to zero- 
difference lines 
(see figures) 


Statistical 
significance b/ ' 




Above 
line 


Below 
line 


On 
line c/ 


. 


Validity— Family background items 
lA. Seniors \s, sophomores 
1 R Fpmntp vq male students 
IC. Black vs. white students 
11). Hij^h low test score 

IE. HiHh vs. low SES students 

IF. Father-child mother-child 


12 
35 
29 
35 
34 
29 


11 
27 
5 

32. 
23 
17 


0 
3 

22 

10 
8 


1 
5 
2 
1 

1 

4 


»♦ 
*• 
** 
* 

t 


Reliability— Family background items 
2. Seniors vs. sophomores 


31 


22 


8 


1 




ramuy uacKgruunu iiciii!) 
3. Reliability vs. validity 


31 


25 


4 


2 




vaiiuiiy — ocnooi-reiaicu ucms 
4A. Female vs. male students 
43. Black vs. white students 
AC. High vs. low test score 
4D. High vs. low SES students 


14 
14 
14 
14 


12 
0 
13 
10 


1 

14 
1 
3 


1 

0 
0 
1 




Reliability— School-related items 
5. Seniors vs. sophomores 


15 


14 


1 


b 




Consistency— Grades, attitudes, plans 

6A. Seniors vs. sophomores 

6B. Female vs. male students 

6C. Black vs. white students 

6D. High vs. low test score 

6E. High vs. low SES students 

6F. Father-child vs. mother-child 


10 
28 
• 28 

28 
28 
26 


9 
13 
3 

18 
9 

12 


1 

12 
25 
9 
18 
12 


0 
3 
0 
1 
1 
2 


NS 

t 

t 

NS 



t 



a/ As applied here, .he sign .est is a non-parametric test based on the probability associated with the occurrence of a particular number of 
points above (plus) and below (minus) the zero-difference line as determine^ by reference to the bmom.al distribution (Siegal. 1956). 

b (M,e..a,lcd tests of signitlcance were employed in all comparisons except those based on the sex of the student and sex of «he Parent lor 
xraUcs attitudes, and plans. The symbols t, V and indicate statistical significance in the direction hypothesized, if an>|^ at the JO, .05. 
and oi levels, respectively; and NS means not significant at the .10 level. It was hypothesized that seniors and white high test score and 
high Srs students provide better quality and more consistent data than sophomores or black, low test score, or low SES students, i also 
wa\ hypothesized >hat there would be better agreement between student responses and those of their fathers than those of 'he'r mothers for 
tam.iy background anu in.:al and college items. Furthermore. U was hypothesized that reliability coefficients would be higher .han 
validity coefficients. 

^ - A point is considered lo be "on ihs line" if its coordinate values, rounded to two decimal places, are equ?l. 
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Parent questionnaire respondent's sex. Thus far the discussion has been, about the validity of student 
questionnaire responses as a function of student characteristics. The parent's response has been the stan- 
dard'^against which the validity of the child's response has been judged. Parent responses, of course, ac- 
tually are of varying degrees of accuracy. It was thought that the father might provide more accurate in- 
formation than the mother for many family background items. Thus, validity coefficients for those cases 
where mothers (or other females) had answered the parent questionnaire were compared with those cases 
where the respondent had been a male (figure IF). 20 it was found that there was a tendency for male- 
referent coefficients to be slightly higher than female-referent ones, the two sets of coefficients averaging 
.635 and .612 respectively. This difference also can be considered as evidence of a fallible standard, and 
thus to be indicative that the coefficients calculated in this study understate the actual quality of student 
questionnaire data. 

3.1.2 Bias — parent as standard. The previous section examined the degree of correlation between the ques- 
tionnaire responses of children and their parents. This section looks at differences in response means of 
children and parents. If the mtan for students is higher than that for their parents, this is evidence of a 
positive bias. A positive bias is associated with over-reporting by the student, a negative bias with under- 
reporting. 

Table A-2 shows that sophomores under-reported that they have a specific place to study (48 vs, 57 percent) 
and that the home has a pocket calculator (80 vs. 87 percent), but over-reported that the family has two or 
mo' ars or trucks that run (79 vs. 75 percent) and that the horne has 50 or more books (85 vs. 81 percent).2i 

StuGw-nes over-reported that their parents have a high school education only (45 vs. 36 percent for sophomore 
mothers), but under-reported that their parents have had some but less than 2 years of postsecondary educa- 
tion (10 vs. 24 percent for sophomore parents). The size of the bias in student reports of parental education 
tends to be somewhat smaller for father's than for mother's education level, and smaller for seniors than for 
sophomores. 

Students tended to underclassify their father's occupation as clerical (2 vs. 5 percent, sophomores) and crafts- 
man (17 vs. 23 percent, sophomores)^ but to overclassify their fathers into the categories of farmer (5 vs. 2 
percent) and laborer (10 vs. 5 percent). Children underclasrified the occupations of their mothers as clerical 
(31 vs. 35 percent, sophomores), but overclassified their mother's occupation as laborer (3 vs. 1 percent) and 
professional or school teacher (23 vs. 17 percent). 

Students under-reported that the family income was either very low or very high, instead over-reporting it to 
fall within an intermediate range. For example, 68 percent of sophomores but only 40 percent of their parents 
reported income values between $7,000 and $25,000 per year. Overall, children underestimated the income of 
their family by an average of about $3,000 or 12 percent.22 

Those students who indicated they come from a foreign-language background tended to over-report that the 
language is Spanish (31 vs. 27 percent, sophomores). 

These students, when asked whether another language also was spoken in the home, tended to over-report 
that there was a second language (78 vs. 72 percent, sophomores) and to identify it as Italian, French, or Ger- 
man (18 vs. 10 percent, sophomores). In most cases, the^biases were smaller for seniors than for sophomores. 

3.1.3 Reliability— twin file. Table A. 3 presents estimated reliability coefficients for 33 family background 
variables, a much larger number than could be included in the validity study.23 Thus, use of twin data allows 
ainore extensive investigation of data quality. Forty-two percent of the coefficients are at least .75 in value, 
44 percent are between ..50 and .74, and only 14 percent are less than .50. Reliability coefficients are sum- 
marized in table 3.4. Note that for seniors the coefficients are about .90 for parental education level, .75 for 
family income (seven categories), .65 for father's occupation, and .86 for the SES composite. 



2<^hcra is evidence that in some instances, while the mother was the designated respondent, the father actually completed the section of the 

questionnaire dealing with financial matters. No attempt was made irt this study to adjust for those circumstances. 
2* AH of the bias estimates pointed out in this section of the report differ from zero by at least two standard errors. (Sec table A. 12 for standard 
error values). 

22if oincr income items such as dividends, interest, and rent had been included in the estimate of family income, the overall bias would have 
been smaller. Dresch ei al. using the broader deOnitions* found a mean of $28,000, which was quite close to the U.S. Bureau of Census 1979 
Current Population Survey estimated mean income for families headeU by persons age 45 to 54 of $28,200. 

23Some of the variables in the reliability analysis could not be included in the validity analysis because ihc information was not asked for in the 
parent questionnaire. 
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Table 3.4. Summgry of estimated reliability coetHclents for 1980 sophomore and senior responses to family 



Variable 


Reliability coefficient 




Seniors 




Sophomores 



Socioeconomic status composite 

Father's, mother's education level 

Father's, mother's occupation 

Family income (three, seven categories) 

Electric dishwasher in home 

Two or more cars or trucks that run 

Typewriter in home 

Other items in home 

Number of rooms in home 

Own or rent house or apartment 

Father, mother lives in household 

Mother worked at various points in time 

No. of years parents, student lived in U.S. 

Student was born in U.S. 

Student's age, race, religion 

No. of siblings in college, high school next fall 



.32 
.94, .85 
.56, .51 
.66, .69 
.85 
.72 
.70 
.19 to .57 
.64 
.58 
.84, .44 
.62 to .78 
.70 to .79 

.% 
.69 to .82 



.89, .90 
.65, .53 
.71, .75 
.81 
.70 
.75 
.30 to .60 
.71 
.60 
.86, .51 
.63 to .84 
.77 to .81 

1.00 
.78 to .89 
.68, .84 



As anticipated, the questionnaire responses of seniors tended to be more reliable than those of sophomores 
(See figure 2.) The means of the reliability coefficients for the 3 1 variables measured for both cohorts are .701 
for seniors and .664 for sophomores. Earlier (section 3.1.1) it was pointed out that seniors provided more 
valid responses than did sophomores. 

3.1 4 Comparison of validity and reliability coefficients. Both reliability and validity coefficients were 
estimated for 19 sophomore cohort and 12 senior cohort family background variables. Conceptually, 
reliability sets an upward bound for validity (Werts et al., 1974). This theoretical relationship between 
reliability and validity is supported by our data (figure 3).24 The two statistics are highly correlated (r « 
.915), and the mean reliability coefficient is higher than the mean vahdity coefficient (.671 vs. .619).25 
Thus the validity of student questionnaire responses for many variables other than ^^ose covered in the 
parem questionnaire can be approximated from the corresponding reliability coefficiems. This should hold 
true for school-related as well as for family background variables. 

3.2 School-related Variables 

3 2 1 Validity-transcript as standard. The quality of senior questionnaire data was checked against 
transcript for high schoSl grades, amount of coursework taken from the beginning of 10th grade through the 
end of the current school year in each of seven subjects, and whether or not each of six specific courses ever 
had been taken. 

Grade point averages were calculated by NCES from the data on course grades and credits earned (Carnegie 
units) in the transcript file. Grades had been calibrated to a common scale by NORC based on a standardized 
13-point grade scale.26 Students reported grade averages on an 8-point scale ranging from Mostly A (a 
numerical average of 90-100)" to "Mostly below D (below 60)." The numerical values associated with letter 
grades in the student questionnaire did not agree with the corresponding numerical values for any of the three 

24Congcrer«/ (1976) also concluded based on a review of reliability and validity studies that validity results generally are in agreement 

with the findings on reliability, with the reliability level putting a constraint on the maximum value of the validity coefficient. 
"»5Th. onlv ,wo items shown in figure 3 to have reliability coefficients more than marginally lower than their validity coefficients (namely. 

lophomore poikrcS items) L ones for which the sophomore reliability coefficient was unusually low relative 

to the senior reliability cof^fficieni (Hpurc 2). 
26Code values ranged from 1 for A 2 for A-. 3 for B . . down to 13 for F. Numerical grade values (e.g.. 74. 93) were assigned code values 

using one of three grade scales depending on the minimum passing grade. See Jones et al. (1983). 
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Estimated reliability coefficients for student responses to family 
background questionnaire items: 1980 senior vs« 1380 sophomores^ 




grade scales used in coding transcripts. 27 Despite such problems, the responses of students correlated fairly 
highly (.77) with grade averages derived from their transcripts (table A.4). This coefficient is not quite as high 
as one might have expected based on the correlation coefficient of .76 between senior and parent data found 
in a subsequent section of this report. The parent questionnaire response categories, however^ were identical 
with and thus directly comparable to those in the student questionnaire, whereas calculation of grade point 
averages from high school transcripts involved a number of assumptions. 



27For example, the student questionnaire category was '^Mostly B {80-84j/* whereas in the transcript coding scheme. B corresponded to 
numerical values of 83-86. 86-88. or 88-91, depending cn the minimum passing grade. 
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Figure 3. -Comparison of estimated reliability and validity coefficients for student 
responses to family background questionnaire Items: 1980 sophomores 
and seniors 




Validity coefficient 



Seniors were asked, "Starting with the beginning of the tenth grade and through the end of this school year, 
how much coursework will you have taken in each of the following subjects? Count only courses that meet at 
least three times (or three periods) a week." Eight answer categories were provided ranging from "None" to 
"More than 3 years" in half-year intervals. For this study, transcript data on total number of credits earned 
for the three school years 1979-80, 1980-81, and 1981-82 were calculated and mapped into the eight student 
answer categories.28 This was done for the subject areas that correspond to the "new basics," as described by 
the National Commission on Excellence in Education in its 1983 report A Nation At Risk: The Imperative for 
Educational Reform. Remedial English and mathematics courses were included in the transcript counts of 
units earned. 29 



28Transcript course titles were coded in accordance with the taxonomy given in Ludwig e( al. (1982). 

29Further information on the assignment of courses to the subject areas examined in this report is available on request from NCES. 



The quality of student reports on amount of coursework was found to vary considerably by subject area: 
from highs of about .87 for French, German, and Spanish; to .70 and .66 for science and mathematics, 
respectively; to .39 for history or social studies and .28 for English or literature (table A.4). It should be noted 
that all students, regardless of their academic skills and other characteristics, tend to take about the same 
amount of coursework in the areas that have the lowest coefficients; but students vary considerably more in 
the amount of coursework taken in areas that have high coefficients. For example, students in the top test 
score quartile took only one-quarter more semester in English and literature but over more 
semesters of science than those in the bottom quartile (table A. 5). Furthermore, the standard deviations of 
the distributions for all seniors were only I A semesters for English but 1.9 semesters for science (not tabled). 

The third, but related, area of data quality investigated by use of transcript data was whether the senior ever 
had taken (counting the present semester) each of six specific courses in mathematics and science. The student 
was considered to have taken a course in, say, trigonometry if a unified mathematics course was taken that 
included trigonometry. Coefficients were found to be in the .80's for chemistry (.87), physics (.80), and 
geometry (.85) and in the .60's for second-year algebra (.68), calculus (.67), and trigonometry (.63) (table 
A.4). To the extent that some students might have taken some of these courses earlier than the 9th grade, 
these coefficients would be underestimates of the quality of student reports. As will be seen shortly, there is 
some evidence that this is the case for second-year algebra, geometry, and trigonometry. Thus, again because 
of use of a somewhat fallible or noncomparable standard, the true quality of student reports of coursework 
in these areas undoubtedly is somewhat higher than indicated by the coefficients estimated in this study. 

The quality of student information on grades and coursework is not the same for all students. Subgroups dif- 
fer very much in the same way as they were found to differ with regard to validity of family background 
variables. Data quality is slightly higher for females than for males; and it is considerably higher for white 
students, students who score high on cognitive tests, and students from high SES backgrounds than it is for 
Hispanics or blacks, students who do poorly on cognitive tests, and students from low SES backgrounds 
(tables 3.5 and A.4 and figure 4). The relation of data quality to test score quartile is especially strong, the 
mean coefficient varying from .47 to .73. The fact that an otherwise very strong pattern is broken between the 
third and top quartiles for three of the mathematics courses (table A-4) probably reflects a problem with the 
standard. Perhaps the brightest students took some of their mathematics courses prior to the period covered 
by the transcripts. 



Table 3.5. Mean validity coefficients for 14 school-related variables for subgroups of 1980 sophomores in 1982 
(transcript study) 





Mean 


Subgroup 


validity 




coefficient 


Sex: 




Male 


.689 


Female 


.721 


Race/ethnicity: 




White 


.734 


Hispanic 


.600 


Black 


.630 


Test score quartile: 




Lowest 


.472 


Second 


.620 


Third 


.706 


Highest 


.734 


Socioeconomic status quartile: 




Lowest 


.633 


Second and third 


.706 


Highest 


.707 
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Fiaure 4 -Eitimated validity coefficients for student responses to Items about grades 
Figure 4. ^"j*^-^^,^^^^^ (transcript data as standard): 1980 sophomores in school In 1982 

A. Female vs. male students B. Black vs. white students 



1 00 




A 

CD 




0 20 *0 .60 .80 

Validity coefficient. Male ttudents 

C. High vs. low test score students 



1.00 



.20 .40 .60 80 

Validity coefficient: While »iudent» 

D. High vs. low SES students 



1.00 



1 00 



Phytic 5 



.SP 
I 



Geometry 





20 40 60 90 

Validity coefficient' Lowest test quartHe 



1 00 



.20 40 60 80 

Validity coefficient. Lowest SES quartite 



1.00 



•See tables 3.3 and A.4. 

3 2 2 Bias-transcript as standard. To examine the bias aspect of the quality of student responses for grades 

ft was nr! necessary to 13-point transcript scale into the S^point student scale.30 (Because the highest 

nrerval wa^op^^^^^^^^^^^ amount of coursework already had been mapped into the student questionnaire 
aKgo irfo?rcorrdatio^ aspect of .he investigation of data quality ) A further transforrnation en wj^ 

made to the data from both sources so that A = 4 (previously coded 1), B = 3 (previously coded 3), C-2 

(previously coded 5), and D = 1 (previously coded 7). 



30rranscripi grade-poini average values were transformed lo student questionnaire code values as follows: 



Tninsciipl 

Less than 2.50 
2.50 to 4.49 
4.50 to 5.49 
5.50 to 7.49 
7.50 to 8.49 
8.50 to 10.49 
10.50 10 11.49 
11.50 or higher 



Student 

1 (Mostly A's) 

2 (About half A's and half B's) 

3 (Mostly B*s) 

4 (About half B's and half C's) 

5 (Mostly C*s) 

6 (About half C's and half D's) 

7 (Mostly D's) 

8 (Mostly below D) 
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Students tended to report slightly higher grade averages than those calculated from their transcripts (table 
3.6). The student mean is about one-fifth of a letter grade above the transcript mean. The amount of bias is 
slightly higher for black than for white or Hispanic students (0.3 vs. 0.2 letter), but the variation in bias values 
among sex, test score, and SES groups is negligible (table A.5). 

Students also tended to overstate the amount of coursework they had taken or were taking in all areas except 
history or social studies (table 3.6). The size of the bias is greatest for mathematics (1.1 semester), next 
greatest for science (0.6 semester), and one-fourth a semester or less for each of the other subject areas. 



Table 3.6. Estimated bias in responses of 1980 sophomores to 1982 questionnaire items about grades, 
coursework, and courses 



Subgroup 


Source 


Bias 


Student 


Transcript 


Grade average (letter grade units)* 


2.84 


2.62 


.22 


Amount of coursework (years): 








Mathematics 


4.15 


3.07 


1.08 


English or literature 


5.81 


5.56 


.25 


French 


.58 


.44 


.14 


German 


.17 


.13 


.04 


Spanish 


.94 


.72 


.22 


History or social studies 


4.58 


4.63 


-.05 


Science 


3.43 


2.87 


.56 


Ever have taken or are taking (percentage); 








Second-year algebra 


48.7 


38.1 


10.6 


Geometry 


55.1 


48.8 


6.3 


Trigonometry 


25.6 


14.4 


11.2 


Calculus 


8.8 


5.3 


3.5 


Physics 


19.5 


15.3 


4.2 


Chemistry 


36.9 


32.2 


4.7 



♦Scaled A = 4, B = 3, 0 = 2. D= 1. 



The magnitude of the bias in amount of coursework is about the same for the various subgroups of students 
for two of the four areas for which subgroup comparisons were made (viz., English or literature and history or 
social studies); but for mathematics and science, bias is considerably higher for Hispanics, blacks, students 
who score low on cognit'Ve tests, and students from low SES backgrounds than it is for other students (table 
A. 5). 31 For example, the bias in student reports of amount of mathematics is 1.8 semesters for black 
students, but only 0.9 semester for white students. In fact, the mean self-reported figure is higher for black 
than for white students (4.5 vs. 4.2 semesters), whereas the transcript mean is lower (2.7 vs. 3.3). To cite a se- 
cond example, the bias for mathematics, proceeding from lowest to highest test score quartile, declines from 
1.8 to 0.6 semester. 

Finally, it was found that students tended to over-report that they had taken (or were taking) specific 
mathematics and science courses (table 3.6). For example, student questionnaires yield an estimate of 55 per- 
cent for geometry as compared with an estimate of 49 percent obtained from transcripts. 32 

3.2J Reliability— twin file. Table 3.7 summarizes the information contained in table A. 6 on reliability of 
sciiool-related variables. This is based on the extent of agreement of the questionnaire responses from the 
members of twin sets. The coefficients cover a very wide range of values— from less than .10 to over .90. 

The coefficients are fairly high for school attendance and student-body composition variables. The reliability 
of student responses to the question about whether the school has a minimum competency or proficiency test 




3iThis part of the analysis was limited to the four major subject areas that are mentioned. 

32subgroup.s were not compared with regard to bias in student reports of whether specific courses had been (or were being) taken. 
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program is disappointingly low. The school questionnaire, however, is a more authoritative source of infor- 
mation for this variable; and there would seem to be little if any need to resort to student-reported data.33 

Table 3.7. Summary of reliability coefficients for r hool-related variables (twin file): 1980 sophomores 
and seniors 



Variable 



Kindergarten attendance 

When began attending this school 

Number of school changes 

School racial/ethnic composition, earlier grades 

Minimum competency lest 

Enforced school rules 

School disciplinary problems 

School rating 

Instructional methods 

School problems interfering with education 



Reliability coefficient 



Sophomores 


Seniors 


.93 






.89 


.77 




.58 to .76 


.68 to .83 


.45 


.68 


.26 to .54 




.18 to .38 




.21 to .39 


.24 to .52 




.05 to .33 




.14 to .24 



As would be expected, the coefficients associated with the remaining five items are moderate or low m size. It 
should be noted that the two members of each twin pair were not necessarily exposed to identical school en- 
vironments and experiences. Thus, to the extent they were not. the reliability coefficients for some items (such 
as instructional methods experienced) may be underestimated. On the other hand, the responses of twins will 
agree more closely than will the responses of two randomly selected students within a school to the extent that 
twin responses reflect that influence of attitudes and standards that are learned in the common home.34 More 
importantly, two other considerations should be kept in mind for these last five items. First, each of them has 
five to eight sub-items. In many instances it is more appropriate to combine these sub-items into composite 
measures than to employ them as individual sub-items. Second, for many analyses it is appropriate to ag- 
gregate the data for these kinds of items to the school level. The reliability of a composite measure, of course, 
would be greater than that of its component sub-items; and the reliability of a mean of up to 36 observations 
would be considerably higher than the reliability value for an individual student.35 

In figure 5 the reliability coefficients for seniors are plotted against those for sophomores. Seniors provided 
considerably more reliable school data than did sophomores. For the 15 variables plotted in figure 5. the 
mean reliability coefficients are .537 for seniors. .439 for sophomores. 

3.3 Other Variables 

This section of the report examines the consistency of parent-child responses to questions primarily regarding 
perceived influences, expectations, aspirations, and attitudes. In only one instance (namely mother's aspira- 
tions for child's education) can the statistics be considered to measure the quality of student questionnaire 
data. 

3.3.1 Consistency of parent-child responses-grades, plans, attitudes. Table A.7 shows the estimated 
amount of correlation between parent and child responses to questions concerning the child's grades, plans, 
and attitudes. The results are summarized in Table 3.8. 
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3lTWidhy of s.udcn. reports was no. checked against minimum competency data reported in the school questionnaire. The validity coefr.- 
cicnts, however, should be slightly lower than the reliability coefficients (section 3.1.4). ^ 

34Sonic prcl.mmary analysis by NCHS indicates that the correlation between twin responses tends to be about 50 percent higher lhan lhai for 
randomly selected studetm in the same school for the questionnaire -tems pertaining to school discipline problems, school rules, and school 
ratings. 

35For example if the reliabi'-.v of a variable is .20. the reliability of the mean value of the variable for 36 randomly selected students is 
estimated by the Spearman-Brown formula to be .90. (Lord and Novick. 1968). It should be noted, however, that the rcspons« of twins 
will tend to agree more closely than will the responses of two randomly selected individuals within a school. Thus the Spearman-Brown for- 
mula will tend to over-estimate the reliability of school means derived from twin-based estimates of correlation coeffiaents. 
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Figure 6.— Estimated reliability coafflclentt for studnnt retpontet to school-related 
questionnaire Items: 1960 sophomores and seniors* 
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Table 3.8. Summary of consistency coefficients— Grades, plans and attitudes 



Variable 



Consistency coefficient 



Sophomores 



Seniors 



High coefficient (over .70): 
High school grade average 

Moderate coefficient (.50 to .69): 
Mother's aspirations for child's education 

Low coefficients (.00 to .49): 
Age expects (is expected) to marry, etc. 
College expectations in earlier grades 
Child's ability to complete college 
Child's occupational expectations 
Influence of parents on post-high school plans 

Sex role attitudes 



.75 

.57 

.27 to .43 
.43 to .45 

.40 

.31 

.18 to .21 



.76 

.59 

.40 to .57 
.40 to .46 

.42 

.37 
.18, .21 
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The amount of agreement between parent and child is highest for grade average (about .76)36 and for 
mother's aspiration for child's education (about .58). There is moderately good correspondence m answers 
between seniors and their parents regarding the age at which certain events are expected to occur: marriage 
(.57), first child (.51), start regular job (.48). All other coefficients are less than .48, and some are as low as 
about .20 (namely, those for parental inttuence on post-high school plans and sex role attitudes). 
Figure 6-A reveals that the answers of seniors and their parents agree more closely than do the answers of 
sophomores and their parents. The mean coefficients for 10 variables are .498 and .431, respectively. 
There wa. better agreement between daughters and parents than between sons and parents regarding events 
related to family formation: marriage, Hrst child, and home ownership (table A.7 and figure 6-8). Otherwise, 
the estimated coefficients for sons and daughters are about the same. 

For most variables consistency coefficients are lower, often considerably so, for minority-group students 
than for white students (table A.7 and figure 6-Q. The average coefficient for 28 variables is .300 for black 
students, .375 for Hispanic students, and .436 for white students. 

Consistency between parent-child responses regarding high school grade average is higher for students who 
scored well on tests than for those who made low scores-about .78 vs. about .58 (table A.7). Otherwise, the 
points plotted in Figure 6-D indicate no clear edge to students who made high test scores.37 
The pattern of results by SES quartile is mixed (figure fr E). There is better parent-child agreement for high 
than for low SES students for grades, sex role attitudes, and age the student will get a regular job, but not for 
most other variables. The results are particularly favorable to low SES students for the variables concerning 
when the student will marry, have first child, and live in own home, and whether the student had college plans 
when in earlier grades. 

It makes little difference which parent answers the parent questionnaire (figure 6-F). The mean consistency 
coefficients are .40 for both mother-child and father-child contrasts. 

3.3.2 Mean difference between parent and child response-grades, pl«n.. atUtuda. U»j"8j^e c^^^^^^^^^ 

as a basis of comparison, table A.8 shows that: (a) parents were more likely to report high grade averages 40 
V 35^rcent or better, seniors); (b) parents were more likely to believe events in the hves of their children 
wi 1 ocrurTate?(e.g., 33 percent of their parents but only 27 percent of sohomores thought marriage will oc- 
Tu r aTag 25 or a?e ); (c^mothers were more likely to report that the mother expects the child to get some 
but less than 2 years o postsecondary education (5 vs. 19 percent for sophomores); (d) parents were more 
lik ly to betfeve "yes, definitely" the child has the ability to complete college (58 vs. 39 percem, sophomor«0^ 
brn we^e less likely ii report that they expected the child to go to college when the child was in earlier grades 
(69 vs. 75 percent for 8th and 9th grades, sophomores). 38 

3.3.3 Consistency of parent^hlld responses-financial and college Items. The highest correlation coefficient 
between parent and child responses to questions regarding living and schooling «P«"»"'/°"«8Vq?, ' 
coS choice factors is .61 for estimated schooling expenses, September 1980 ^^rough Augu 98H^^^^ 
A.9) The coefficient for estimated living expenses for the same period, on the other hand. Is quite low (.22). 

The consistency coefficients are low (.07 to .38) for 11 of 13 possible '^^^^''^ f ,!^°^^ ^l^^'o^^ 
student's living and schooling expenses. The two exceptions are "parents' and social security or VA 
(Veterans Administration) benefits." The estimated cocfficiem for each of these two sources is .47. 
Parent and child estimates of the cost of attending various kinds of postsecondary institutions are only weak- 
ly correlated. The coefficients range from .06 to .25. 

Finally, parents and children assessed the importance of seven factors in choosing a college. The highest con- 
sistency coefficients are for "able to live at home and attend college" (.56) and "availability of financial aid 
(.44). The other five coefficients vary from .11 to .32. 

36^nce the parent', report do« not «t . f«tual standard. .76 may be considered a lower bound for the validity of student self-report, of 
grade point averages. 

37The number of point, above the line in Figure 6-D is not significantly different from the number below. Excludmg grade average, the me«» 

coefficient is .355 fot high-scoring and .315 for low-scoring students. 
38A11 of the estimates of relative bias cited in this section and a later section concerning financial college items differ from «ro by at least two 

standard errors. (See table A. 12 for standard error values.) 
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Figure 6. -Estimated coefficients of consistency between cliild and parent responses to questionnaire 
items about grades, attitudes, and plans* 
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As may be observed in figures 7-A through 7-E, there is greater consistency in parent-child responses for some 
kinds of students than for others. The mean coefficient for the 28 variables is higher for female than for male 
students (.267 vs. .229), for white (.267) than for Hispanic (.180) or black (.171) students, for students who 
scored high on cognitive tests than for those who scored low (.300 vs. .159), and for students from high SES 
backgrounds than for those from low SES backgrounds (.279 vs. .200). Finally, the responses of students 
were more consistent with those of their fathers than those of their mothers (.272 vs. .232). 

3.3.4 Mean difference between parent and child responses— financial and college Itenu. Parents were much 
more likely than seniors to report that the child would not require any money for living expenses for the 
period September 1980 through August 1981, (42 vs. 27 percent) (table A-10). They also were more likely to 
report that the child would not require any money for schooling expenses during the same period (28 vs. 23 
percent). As illustrated in table 3.9, parents estimated the yearly costs of attending postsecondary education 
institutions to be lower than the costs estimated by their children. 



Table 3.9. Relative bias in estimates by sophomores and their parents of cost of attending postsecondary 
institutions, by type of institution 



Type of Institution * 




Percent 


Est. yearly cost 


Sophomores 


Parents 


Junior or community college 
State 4-yr college or university 
Private 4-yr college or university 


Less than $1,000 
Less than $2,000 
ess than $5,000 


50 
30 
50 


59 
42 
56 



Seniors were considerably more optimistic than their parents that they would be able to pay for at least some 
of their living and school expenses from their own savings (71 vs. 35 percent) and earnings (74 vs. 63 percent) 
and by means of a scholarship, grant, or loan (e.g., 26 vs. 17 percent for Federal scholarship or grant). 

Finally, parents were more likely than seniors to rate as "very important" in choosing a college: "college ex- 
penses" (53 vs. 37 percent;) "reputation in academic areas" (75 vs. 53 percent); and "able to live at home and 
attend college" (33 vs. 22 percent); but parents were less likely to consider the "social life at the college" to be 
very important (1 1 vs. 28 percent). 
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Rgure 7. — Estimated coefficients of consistency between child and parent responses to financial and 
college-related questionnaire items: 19B0 sophomores and seniors* 
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Chapter 4 — Summary' and Discussion 



This study employed data collected from parents, high school transcripts, and twins to examine the validity and 
reliability of responses of high school students (sophomores and seniors) to questionnaires administered to them in 
a group settinjj. The validity portions of the study examined a variety of family background and home environment 
variables (23 items), high schoOi grade average, amount of coursework taken ( / items), and whether certain specific 
courses had been taken (6 items). Data collected from twins, the reliability portion of the study, broadened the 
scope of the investigation of data quality. Additional family background and home environment variables could be 
examined with twin data (32 items in all plus an SES composite), as well as variables concerning school conditions, 
problems, and practices (20 items) and the students' earlier and current school experiences (17 items). The con- 
sistency of child and parent responses to questions dealing with aspirations, expectations, attitudes, opinions and 
plans also was examined (43 items). 

The results of these examinatioijs of data quality were presented in the previous chapter. They have a number 
of implications for the analysis and interpretation of HS&B data and for the design of future surveys. 

A. Data collection. 

While highly reliable data can be obtained for some events that happened in the past (e.g., kindergarten attend- 
ance), there generally is a decay in quality as the recall period lengthens (e.g., with regard to whether the stu- 
dent's mother worked at various stages of the student's life). This result is consistent with the findings of other 
researchers (section 1.2); and suggests, for example, that adults would not provide very accurate information 
about many aspects of their earlier high school days. 

The difficulty of respondents to accurately recall past events and experiences, much less earlier attitudes, of 
course, is the primary reason for undertaking prospective longitudinal studies such as HS&B. Longitudinal 
studies are essential to collect reliable event history and other data. Cross-sectional surveys cannot be relied 
upon to gather accurate data about the past. 

B. Composites and means. 

The vast majority of the variables examined in the study were contemporaneous rather than retrospective in 
nature; and most of these dealt with factual rather than attitudinal matters. The validity and reliability coeffi- 
cients for these contemporaneous, factual variables exhibited considerable variation, from about .20 to over 
.90. The only home and family background variables that had coefficients less than .50 for both cohorts were 
four that can enter a "household possessions" composite, which in turn can be employed as components of an 
SES composite. It is very encouraging that the SES composite that often is employed in analyzing HS&B data 
not only has a high coefficient (mid .80s), but is available for virtually all students. 39 

Quite a few of the school-related variables required the student to exercise judgment, for example, in forming 
an opinion regarding the extent to which certain school rules were enforced. The validity (or reliability) values 
for these opinion variables tended to be lower than for the more factually oriented ones such as whether certain 
specific courses had been taken. The opinion variables, however, generally are quite suitable for use in com- 
posites. 

It seems quite clear from these results that analysts should make full and appropriate use of composites (such 
as possessions in home, SES, and several that may be formed from items regarding school climate). Not only 
should the composites have high validity and reliability coefficients, but values of the composites should be 
available for virtually all subjects. On the other hand, use of selected individual component items as proxies for 
the entire set generally should be avoided. 

39a composite value was calculated for students who provided data for at least two of the five components. Thus about 95 percent of the 
students have SES composite values even though data are available for only 80 percent of the students for some component items. 
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In several instances, students were used as observers and reporters of school conditions, policies, and practices. 
Not only should the data analysts consider the use of composites in these instances but they also should con- 
sider whether it would be more appropriate to aggregate the data to the school level and employ school 
averages rather than individual student values in the analysis. The reliability of the average, of course, would 
be considerably higher than the reliability value for an individual student, 

C. Statistical adjustment and data interpretation. 

Errors of measurement in either or both variables attenuate or weaken correlation coefficients and, if the error 
is in the independent variable, attenuate regression coefficients. The validity (or reliability) coefficients 
presented in this report may be employed to adjust for this attenuation or may be employed in models that ex- 
plicitly incorporate a provision for measurement error. Validity coefficients, 40 however, were found to depend 
on the characteristics of the students answering the question. The coefficients tended to be slightly higher for 
seniors and females than for sophomores and males but they were considerably higher for students who scored 
high on cognitive tests, high SES students (school variables),41 and white students than for those who perform- 
ed poorly on the tests, low SES students (school variables), and Hispanic and black students. Thus it is impor- 
tant that the adjustment factors used by the analyst be the ones that correspond to the subgroup under in- 
vestigation. 

For some school-related variables, data provided by these subgroups differed not only in the degree of correla- 
tion with the standard, but also in the size of the bias of the response. For example, the correlation coefficient 
for students in the top and bottom test score quartiles for number of semesters of mathematics taken by the 
student were ,78 and .41, respectively; and the same two groups overestimated the amount of mathematl-s 
taken by an average of 0,6 and 1.8 semesters, respectively. Thus the use of student reports could result in a 
serious undere.stimate of the difference between these two groups in the amount of mathematics taken and of 
the relationship of amount of mathematics taken to achievement. 

The variation of validity coefficients and bias values among subgroups also means that the measurement error 
may well be correlated with the value of the variable itself and perhaps with values of some of the other 
variables in the model. Thus the assumption of **well-behaved" error employed in certain structural equation 
models will not be met. 

It may be quite important for correct data analysis and interpretation to employ the transcript file for informa- 
tion about grades and coursework. This is particularly true for coursework in mathematics and science because 
of the large subgroup differences in bias values as well as validity coefficients, but it also is true for English or 
literature and history or social studies because their overall validity coefficients are so low (less than .40), 

D. Future surveys. 

Designers of student questionnaires for new studies should examine the wording and formatting of HS&B 
items, in conjunction with the values of the reliability and validity coefficients, and the item response rates. At- 
tempts should be made to reduce the ambiguity and improve the clarity of items with low coefficients.42 The 
special difficuhy that certain subgroups may have in correctly understanding the item should be kept in mind 
during this review process. If there seems to be little potential for improvement of an item, deletion of the item 
should be considered. This consideration, of course, should take into account the importance and u.se of the 
item. For example, it is doubtful that one would want to eliminate family income because of its importance but 
a *'home possession" item with the same (or even higher) validity coefficient as the income item might be 
deleted with little harm. 

Although the quality of data provided by mo.st students about grades and coursework generally is quite good, 
it is substantially poorer for low achieving and certain other subgroups of students. These same subgroups also 
tend to overstate to a greater degree than other students the amount of coursework taken in some subject areas. 
This situation could easily lead to the formation of erroneous conclusions. Thus it is important that .sufficient 
resources be allocated in future surveys to the collection and processing of the high school transcripts of the 
.sampled students, 

4<>Thc sample <s\/q for twins was not large enough lo support a similar investigation of reliability coefficients except for a conipanson ot those 
of sophonK)res and seniors. 

^Ijhe results for home and family backgroui :l variables are uncertain because many ol these variables entered into the ct^mposiie imli/ed 
to classify students by SliS. 

^^The items whicli had ci>efficienis less than .60 are: six home possession Jtonis (place to study, encyclopedia or other reference books, more 
than 50 books, pocket calculator, daily newspaper, and two or more cars or trucks that run): mother's occupation; house o\^ned or rented; 
mother worked before child attended elemrntary school; mother lives in same household; amount of coursework m \ oi literature 

and history or social studies; and the items contained in the five questions deahng with scfiool problems, praciices. and ciMiduions. 
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Tabic \.U Estimated validity coefficients for responses of 1980 sophomores and seniors to family background 
questionnaire Items, by selected student characteristics and sex of parent quesUonnaire respondent 



Variable 



Cohort 



All 
students 



Male I Female 



Sex 



Racc/cihnicity 
while } Hitptnic | Black" 



Tesl score/quartile 


SES comooMte 


Respondent 


n 


' 1 


* 1 






1 1 
Low J 


Mil J 


High 


Mother/Father 


.6? 


.71 


.79 


.84 








.78 


.83 






.19 


.21 


.22 


.15 


.16 


16 


19 




2,958 


.36 


.32 


.33 


.24 


.34 


.27 


.10 


38 


.27 




.28 


.31 


.34 


.32 








.32 


.37 


2,976 


.38 


.30 


.35 


.32 


.36 


.25 


.15 


.i9 


.36 


2,991 


.42 


.52 


.56 


.66 


.48 


.47 


.61 


53 


.54 


2.991 


.51 


.50 


.56 


.70 


.51 


.51 


.63 


.56 


.56 


2.984 


.58 


.58 


.63 


.69 


.59 


.57 


.60 


.62 


.64 


2.978 


.75 


.82 


.00 




70 


84 


.80 




.86 


2,943 


.72 


.70 


.n J 


B7 


.0 1 


.66 


.80 


B ) 


.82 


2,630 


77 


.77 


.84 


.91 


.46 


.74 


.79 


.83 


.88 


2,708 


.78 


.80 


.86 


.90 


41 


.70 


.80 


M 


.88 


2.116 


.80 


.86 


.88 


.9) 


.54 


.73 


.76 


.89 


.89 


* 2.249 


.37 


.54 


.50 


.48 


.46 


.40 


.56 


.44 


.53 


1,921 


.48 


.39 


.47 


.59 


.44 


.44 


.50 


.46 


.46 


1 .970 


.51 


.55 


.58 


.62 


.41 


.51 


.58 


.59 


.55 


2,220 


.57 


.57 


.56 


.62 


.48 


.56 


.59 


.62 


.60 


2,164 


.40 


.46 


.46 


.50 


A 1 




.27 


.50 


.47 


2.652 


.51 


.52 


.58 


.64 


.50 


.39 


.29 


.57 


.58 


2.650 


.52 


56 


.60 


.57 


.59 


.55 


.52 


.57 


.53 


3,050 


55 


.58 


.63 


59 


.59 


55 


.60 


.58 


.56 


2,990 


.73 


.80 


.78 


.83 


.78 


.77 


.79 


.76 


.80 


3,210 


76 


.82 


.80 


.80 


83 


75 


.80 


.80 


.79 


2.984 


7ft 


.77 


.75 


.88 


.80 


.81 


69 


.69 


.80 


639 


.86 


.82 


.80 


.86 


.80 


.82 


.72 


.79 


.86 


597 


55 


.54 


.64 


.60 


.51 


.53 


.64 


32 


64 


630 


48 


AB 

.00 




74 


60 


.61 


.66 


61 


64 


579 


.39 


.59 


70 


.-•0 


46 


62 


.67 


61 


61 


2.894 


.79 


.83 


.89 


91 


82 


.86 


.90 


8^ 


88 


2.862 


.62 


.68 


.74 


.78 


.68 


.72 


.68 


70 




1,867 


62 




.82 


.74 


.68 


.75 


.75 


72 




1.756 


50 


63 


68 


.69 


.59 


.62 


6^ 


.62 




1.809 


59 


67 


66 


.71 


66 


.62 




6> 




1.721 


44 


44 


.66 


.57 


\\ 




.o 


53 




1,626 


.48 


50 


61 


SO 




52 


51 


M 




1,613 



I. SES composite 

2 Items in home 

a. Specific place for study 

b. tncyclopcdia or other 
reference books 

c More than 50 books 
d- Pocket calculator 
c Daily newspaper 

f. Two or more cars or 
trucks that run 

g. Typewriter 

h Electric dtshwasher 



Parent's education 
a Mother 

Mother 
h. Father 

Father 

4. Parent s occupation* 
a Mother 

Mother 
b. Father 

Father 

5 Family yearly income 

6. Own house, rent, or 
other' 

7. Race 'ethnicity' 

8. Home language'** 

a. Language usually 

spoken 
Language usually 
spoken 
b Other language spoken 
Other language spoken 

9. Number of siblings 

a in college next falU 

b. in high school next 

fall 

10. Mother had job during foil 
a Child was in high 

school 
b. C hild was in 

elementary school 
c Before child ^as in 

elementary school 



Sophomore 

Sophomore 

Sophomore 
Sophomore 
Sophomore 
Sophomore 

Sophomore 
Sophomore 
Sophomore 

Sophomore 
Senior 

Sophomore 
Senior 

Sophomore 
Senior 

Sophomore 
Senior 

Sophomore 
Senior 

Sophomore 
Senior 

Sophomore 
Senior 



Sophomore 

Senior 
Sophomore 
Senior 

Senior 

Senior 

owing periods' 
Sophomore 

Senior 
Sophomore 

Senior 
Sophomore 
Senior 



.80 



.35 
.35 
.39 
.54 

.57 
.63 
.85 

.81 
.85 
.87 
.89 



.45 
.57 
.61 

.50 
.59 

.56 
.58 

.78 
.79 



.74 

.78 
.50 
.61 

.60 
.85 

.70 
.72 
.62 
.65 
.53 
.53 



78 



.28 
.37 
.37 
54 

.55 
.63 
.84 

.80 
.84 
.86 
.89 



.43 

.55 
.60 

.47 
.57 

.54 
.58 

.79 
.79 



.67 

.80 
.58 
.66 

.60 
.85 

.67 
.70 
.62 
.63 
.51 
.47 



.82 

.24 

.40 
.34 
.39 
.54 

.59 
.64 
.87 

.83 
.86 
.88 
.89 

.51 
.50 
.60 
,63 

.51 
.60 

.57 
.58 

.78 
.80 



.73 

.76 
.49 
.66 

.61 
86 

.72 
.74 
.63 
.67 
.55 
.56 



.82 

.20 

.31 
.30 
.34 
.58 

.57 
.65 
.87 

.84 

.87 
.88 
.90 

.46 
.48 

.58 
.61 

.46 
.56 

.57 
.57 



.81 

.81 
.55 
.52 

.64 
.88 

.72 
.75 
.62 
.67 
.50 
.54 



.74 

.24 

.40 
.37 
.40 



.46 

.62 

.73 

70 
.74 
.86 
.85 

.45 
.46 
.58 
.60 

.45 
.54 

.55 
.60 



.53 

.83 
.58 
.32 

.49 

.80 

.66 
.67 
.53 
.59 
.54 
.47 



.74 

.20 

.30 
.38 
.35 
.39 

.50 
.56 
.72 

.69 
.78 
.70 
.80 

.53 
50 
.50 
.58 
44 
.56 

.52 
.56 



.49 

.75 

.65 
61 
.63 
.55 
.44 
.37 



a The statistic employed to measure validity ii Cramer's V. 

b Including only those sludcnts who indicate<: they had some foreign language background 

c The parent questionnaire item included non.coU,,e posisccondary inMitudons and was not entirely dear regarding the induMon v i the 
HSAB student. 

(1 Includes only those cases where a female answered the parent questionnaire, 
e Sample s./e is too ^mall (less ihan 50) to yield sufficiently precise eiumates. 
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Table A.2. Esllmated bias In responses of 1980 sophomores and seniors to family background questionnaire 
items 



Variable 


Sophomores 


Seniors 


Child 


Parent 


Cnild 


D r% ran t 

rareni 


Family yearly incbme: 
0 to $6,999 
$7,000 to $11,999 
$12,000 to $15,999 
$16,000 to $19,999 
$20,000 to $24,999 
$25,000 to $37,999 
$38,000 and above 


12.7 
19.3 
18.7 
17.6 
12.7 
11.4 


14 1 
5.9 
10.8 
10.8 
12.1 
23.3 
22.9 


7.7 
11.0 
17.1 
17.0 
18.9 
15.2 
13.1 


14.7 

6.6 
10.7 
10.8 
12,6 
21.9 
22.8 


Total 
Mean* 


100.0 
$20,600 


100.0 
$24,900 


100.0 
$21,700 


100,0 
$24,600 


Own or rent house or apartment: 
Own 
Rent 

Other arrangement 


77.1 
16.5 
6.4 


79.9 
17.8 
2.3 


79.7 
14.8 
5.5 


82.8 
15.1 
2.1 


Total 


100.0 


100.0 


100.0 


100.0 


Race/ethnicity: 
Hispanic 
Mexican-American 
Cuban 
Puerto Ricati 
Other Latin American 
Non-Hispanic 
American-Indian 
Asian 
Black 
Waile 


7.5 
1.2 
0.9 
2.2 

1.3 

0.8 
13.4 
72.7 


6.7 
1.2 
1.0 
1.3 

2.2 
0.9 
14.0 
72.7 


6.6 
1.1 
1.1 
2.2 

0.8 
1.7 
12.5 

74.0 


5.6 
1.2 
1.1 
1.6 

2.7 
1.6 
12.6 
73.6 


Total 


100.0 


100.0 


100.0 


100.0 



Language usually spoken in horned: 
English 
Spanish 
Italian 
Chinese 
French 
German 
Greek 
Portuguese 
Filipino 
Polish 
Other 

Total 

Items in home: 
Specific place for study 
Encyclopedia or other references 
More than 50 books 
Pocket calculator 
Daily newspaper 
Two or more cars or trucks 
Tvnewriter 
Electric di.shwasher 



58.7 
31.3 
1.6 
0.6 
0.8 
0.5 
0.0 
0.5 
0.5 
0.3 
5.3 

100.0 



47,7 
87.6 
84.6 
80.5 
80.0 
78.5 
75.4 
54.5 



66.5 
26.9 
0.5 
1.2 
0.6 
0.0 
0.0 
0.3 
0.3 
0.3 
3.3 

100.0 



57,3 
88.6 
81.1 
86.7 
7y.7 
74.6 
74.1 
53.8 



60.6 
29.2 
1.2 

1.0 
0.5 
0.3 
0.7 
1.2 
1.0 
0.5 
3.8 

100.0 



63.2 
27.5 
1.3 
1.3 
0.5 
0.2 
0.7 
0.7 
0.8 
0.7 
3.2 

100.0 
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Table A 



.2. (continued). Esllm.led bi» in responses of 1980 sophomores and seniors to family background 





Sophomores 


Seniors 


Variable 


Child 1 Parent 


Child 


Parent 



Mother's level of education: 
Less than H.S. graduation 
H.S. graduation only 
Voc, trade, or business school: 

Less than two years 

Two years or more 
College program: 

Less than two years 

Two years 

Four or five years 

Master's degree 

Ph.D.. M.D.. etc. 

Total 

Father's level of education: 
Less than H.S. graduation 
H.S. graduation only 
Voc, trade, business school: 

Less than two years 

Two years or more 
College program: 

Less than two years 

Two years 

Four or five years 

Master's degree 

Ph.D.. M.D., etc. 

Total 

Mother's occupational category: 
Clerical 
Craftsman 
Farmer 
Laborer 
Manager 
Military 
Operative 
Professional I 
Professional 2 
Protective service 
Sales 

School teacher 

Service 

Technical 

Total 

Father's occupational category: 
Clerical 
Craftsman 
Farmer 
Homemaker 
Laborer 
Manager 
Military 
Operative 
Professional I 
Professional 2 
Protective service 
Sales 

School teacher 

Service 

Technical 

Total 



19.8 
44.7 

3.7 
4.8 

6.0 
6.9 
9.1 
3.5 
1.5 

lOOO 



23.3 
32.3 

3.7 
5.8 

5.3 
6.4 
12.2 
6.0 
5.0 

100.0 

31. S 
2.6 
0.7 
2.9 
9.6 
0.3 
7.2 

11.4 
2.3 
0.3 
6.0 
9.0 
13.6 
2.6 

lOO 



2.2 
16.7 
4.7 
0.3 
9.8 
20.5 
2.3 
13.9 
5.7 
5.9 
2.9 
6.0 
1.9 
2.2 
4.9 

100.0 



19.9 
35.6 

12.2 
2.8 

12.2 
5.4 
8.4 
2.6 
0.8 

Tooo 



21.4 
24.9 

9.1 
4.9 

11.2 
5.6 

11.8 
6.7 
4.4 

Tooo 



34.8 
2.1 
0.2 
0.9 
10.4 
0.1 
10.2 
9.6 
1.5 
0.3 
6.9 
6.1 
14.9 
1.9 

Tooo 



21.0 
41.4 

4.1 
5.2 

7.2 
6.9 
8.8 
4.4 
0.8 



24.3 
28.8 

3.8 
5.3 

6.8 
6.4 
12.7 
6.8 
5.2 

Tooo 

31.1 
2.4 
0.5 
4.0 
9.3 
0.2 
7.7 
10.2 
2.0 
0.6 
7.2 
9.7 
13.0 
1.9 

Tooo 



5.0 


2.2 


23.3 


16.6 


2.1 


4.9 


0.0 


0.0 


5.4 


9.8 


19.3 


21.4 


1.7 


1.5 


14.7 


12.6 


5.4 


8.0 


5.6 


6.5 


2.9 


2.9 


5.7 


5.2 


2.5 


2.1 


3.0 


2.3 


3.5 


3.9 


looio 


looo 



19.5 
37.3 

10.7 
3.0 

11.4 
5.2 

8.8 
3.8 
0.3 

Wj5 



22.7 
25.0 

6.8 
4.0 

11.9 
4.9 

13.5 
6.5 
4.7 

lOOiO 

35.9 
2.3 
0.2 
0.8 
9.3 
0.2 
10.9 
9.0 
0.8 
0.6 
5.7 
7.7 
14.6 
2.0 



4.1 
22.7 
2.8 
0.0 
4.9 
19.3 
1.3 
13.4 
8.0 
5.8 
2.9 
5.8 
2.0 
3.8 
3.2 

looo 
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Table A.2. (continued). Estimated bias In responses of 1980 sophomores and seniors to famliy baclceround 
questionnaire items 



Variable 


Sophomores 


Seniors 


Child 


Parent 


Child 


Parent 



None 
English 
Spanish 
Italian 
Chinese 
French 
^ German 
Greek 
Portuguese 
Filipino 
Polish 
Other 

Total 

Siblings in college next falhc 
None 
One 

Two or more 
Total 

Siblings in high school next fall: 
None 
One 

Two or more 
Total 

Mother usually had a job when child was 
in high school: 
Did not work 
Worked part-time 
Worked full-time 

Total 

Mother usually had job when child was in 
elementary school^: 
Did not work 
Worked part-time 
Worked full-time 

Total 

Mother usually worked before child went to 
elementary school^: 
Did not work 
Worked part-time 
Worked full-time 

Total 



100.0 



27.2 
22,0 
508 

100.0 



34.2 
22,8 
43,0 

100,0 



49.1 
17.2 
33.7 

100,0 



d 




2o.U 


30.5 


25.4 


32.0 


23.8 


22.1 


21.6 


2.7 


5,9 


2.6 


0.3 


0.4 


0 4 


2.4 


3.4 


1 4 


4.8 


6.9 


3 6 


0.3 


0.9 


0.7 


0.6 


0.9 


0 7 


0.2 


1.0 


1.4 


0.5 


1.9 


i 0 


5.6 


9.5 


6 7 


100.0 


inn n 


inn n 




68.4 


5?.8 


— 


23.5 


27.1 




8.1 


n 0 




100.0 


100 0 


— 


47.7 


46,6 




38.2 


38.6 


— 


14.1 


14,8 




100.0 


inn n 


27.4 


25.2 


24,5 


20.4 


23.8 


25.4 


52.2 


51.0 


50,1 


100.0 


100 0 


inn n 


36.4 


36.8 


36,8 


22.9 


21.5 


24.9 


40.7 


41.7 


38.3 


100.0 


100.0 


100.0 


56.2 


53.2 


59.0 


13.2 


13.8 


12.3 


30.6 


33.0 


28.6 



100,0 



100,0 



100,0 



Note. Details may not add to totals due to rounding. 

^Mcans \%ere calculated by usina the midpoints of the Hrst six class intervals and a value of \45.000 for the seventh. 
^'Based on only the subset of students who indicated they came from a foreign language background. 

CThe parent questionnaire item included non-college posisecondary institutions and was not entirely clear regarding the inclusion of the 
HS&B student. 



^Bascd on only those cases where a female answered the parent questionnaire. 
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Table A.3. Estimated relUblllly coeffldento for 
backgro und quwUonnairc Itenu 

Variable 

Socioeconomic status composite 
Father lives in same household 
Mother lives in same household 
Mother worked when student was in 
High school 
Elementary school 
Before elementa y school 

Father's most recent job category 

Father's education 

Years father has lived in U.S. 

Mother's most recent job category 

Mother's education 

Years mother has lived in U.S. 

Student born in U.S. 

Years student has lived in U.S. 

Student's age 

Racial/ethnic group 

Race 

Religious background 
Family income (one-thirds) 
Family income (one-sevenths) 
Family owns or rents house or apartment 
Number of rooms in home 
Items in home: 

Specific place to study 

Daily newspaper 

Encyclopedia or other reference books 
Typewriter 
Electric dishwasher 
Two or more cars or trucks that run 
More than 50 books 
Own room 
Pocket calculator 
No. of brothers and sisters in college 
next fall 

No. of brothers and sisters in high school 
next fall 



reipoues of 1980 sophomores and lenlon to family 



Reliability coefficients 



Sophomores j 



Seniors 



No. of observ ations 
Seniors 



Sophomores 



.82 
.84 
.44 

.78 

.73 

.62 

.56 

.94 

.70 

.51 

.85 

.73 

.96 

.79 

.83 

.69 

.73 

.82 

.66 

.69 

.58 

.64 

.33 
.57 
.37 
.70 
.85 
.72 
.36 
.58 
.19 



.86 
.86 
.51 

.84 
.73 
.63 
.65 
.89 
.77 
.53 
.90 
.81 
1. 00 
.81 
.78 
.89 
.79 
.78 
.71 
.75 
.60 
.71 

.30 
.60 
.49 
.75 
.81 
.70 
.32 
.56 
.40 

.68 



243 
272 
272 

248 

229 

201 

244 

142 

236 

246 

176 

253 

269 

269 

241 

266 

266 

227 

191 

200 

225 

229 

223 
221 

222 
220 
215 
220 
222 
224 
221 



227 
234 
234 

217 

208 

182 

219 

160 

212 

225 

188 

225 

228 

230 

216 

230 

230 

206 
181 
189 
210 
210 

203 

205 

205 

202 

201 

203 

204 

202 

204 

210 




43 ^' 



iJ2 



Table A.4. Estimated validity coefficients for responses of 1980 sopliomores to 1982 questionnaire items about grades, 
courseworl(, and courses, by selected student characteristics* 



Variable 


All 
students 


Sex 


Race/ethnicity 


Test score quartile 


SES composite 


Male 


r Female 


White 


1 Hispanic | 


Black 


Low [ 




1 3 1 


High 


Low 


1 Med. 1 


High 


Grades in high school 


.77 


J6 


.79 


.80 


.66 


.65 


.54 


.66 


.75 


.82 


.68 


.77 


.82 


Coursework, lOvh gra'ae through end of 




























1981-82 school year (semesters): 




























Mathematics 


.66 


.65 


.67 


.71 


.55 


.52 


.41 


.60 


.70 




.56 


.66 


.66 


English or literature 


.28 


.24 


.31 


.34 


.25 


.26 


.20 


.30 


,35 


■1 


.29 


.29 


.29 


French 


.87 


.84 


.88 


.92 


.82 


.80 


.79 


.81 


.84 


.89 


.85 


.87 


.87 


German 


.87 


.85 


.K9 


.89 


.49 


.86 


.65 


.78 


.91 


.91 


.75 


.88 


.86 


Spanish 


.86 


.83 


.^8 


.88 


.80 


.83 


.79 


.86 


.85 


.88 


.82 


.85 


.85 


History or social studies 


.39 


.•9 


.39 


.40 


.29 


.31 


.31 


.36 


.43 


.49 


.32 


.40 


.41 


Science 


.70 


.66 


.73 


.76 


.58 


.61 


.45 


.58 


.70 


.80 


,60 


.70 


.70 


Courses taken through 1981-82 school 




























year (yes/no): 




























Second-year algebra 


.68 


.66 


.69 


.69 


.60 


.56 


.45 


.56 


.66 


.61 


.63 


.68 


.62 


Geometry 


.85 


.84 


.85 


.85 


.81 


.81 


.80 


.81 


.84 


.74 


.82 


.86 


.76 


Trigonometry 


.63 


.63 


.64 


.63 


.67 


.60 


.27 


.55 


.64 


.54 


.61 


,63 


.58 


Calculus 


.67 


.64 


.70 


.67 


,55 


.61 


.00 


.45 


,52 


.68 


.57 


.61 


.71 


Physics 


.80 


.81 


.78 


.86 


.54 


.59 


.29 


.55 


.82 


.93 


.55 


.81 


.90 


Chemistry 


.87 


.85 


.89 


.88 


.79 


.81 


.66 


.81 


.88 


.88 


.81 


.87 


.87 



*The siaiisiics in (his table are based on comparisons of student responses with hi)$ti vchooi transcript data. 
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Table A.5. Estimated bias in res. .ses of 1980 sophomores to 1982 qu^tionnaire items about grades and amount of 
coursework in selected areas, by selected student characteristics 



Variable and data source 




Grade average (letters— A = 
Student 
Transcript 
Difference (bias) 



B = 3,C = 2.D=l) 

2.84 
2.62 



2.71 
2.51 
.20 



2.96 
2.73 
.23 



Mathematics (no. of semesters, grade 10 through end of 1981-82 school year): 

Student ^-^5 ^'.1 

Transcript 3.07 3.17 

Difference (bias) 



1.08 



1.14 



3.03 
.99 



2.91 
2.71 
.20 



4.15 
3.27 
.88 



EnglUh or literature (no. of semesters, grade 10 through end of 1981.82 Jhool year) 

, I II :I 5:67 5.58 

Transcript 

Difference (bias) 



.25 



.27 



.22 



24 



2.57 
2.39 
.18 



3.97 
2.39 
1.58 



5.73 
5.47 
.26 



History or social studies (u . of semesters, grade 10 through end of 198M2 school year): 

, ^63 4.60 4'.70 4'.7l 

Traiiscnpt '^'^^ 

Difference (bias) 



-.05 



.08 



.04 



-.09 



Science (no. of semesters, grade 10 through end of 1981-82 school year). 

f-^"', i;« 1:« 

Transcript ^'J 
Difference (bias) i£5 '21 — 



52 



3.47 
3.00 
.47 



4.43 
4.45 

-.02 



3.13 
2.33 
.80 



2.62 
2.31 
.31 



4.50 
2.65 
1.85 



5.98 
5.63 
.35 



4.58 
4.44 
.14 



3.46 
2.59 
.87 



2.45 
2.21 
.24 



3.63 
1.79 
1.84 



5.74 
5.47 

.27 



4.38 
4.32 
.06 



2.79 
1.95 
.84 



2.60 
2.41 
.19 



3.65 
2.46 
1.19 



5.78 
5.55 
.23 



4.55 
4.61 
-.06 



2.87 
2.27 
.60 



2.90 
2.68 
.22 



4.08 
3.29 
.79 



5.84 
5.58 
.26 



4.60 
4.71 

-.11 



3.37 
2.90 
.47 



3.31 
3.08 
.23 



5.02 
4.44 
.58 



5.98 
5.78 
.20 



4.72 
4.88 
-.16 



4.38 
4.10 
.28 



2.64 
2.44 
.20 



3.68 
2.27 
1.41 



5.72 
5.48 
.24 



4.49 

4.51 
-.02 



2.92 
2.29 
.63 



2.85 
2.63 
.22 



4.07 

3.03 
1.04 



5.82 
5.56 
.26 



4.53 
4.64 

-.11 



3.26 
2.78 
.48 



3.07 
2.84 
.23 



4.76 
4.02 
.74 



5.97 
5.72 
.25 



4.69 
4.81 
-.12 



4.09 

i.66 
.43 
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Table A.6. Estimated reliability coefficients for responses of 1980 sophomores and seniors to school-related 
questionnaire items 



Variable 


Reliability coefficients 


No. of observations 


Sophomores 


Seniors 


Sophomores 


Senior*; 


Instruction methods used in course taken this year (used never, seldom, fairly often, or frequently): 






Listening to the teacher's Iwture 




.25 




229 


Participating in student*centereJ discussions 




.28 




220 


Working on a project or in a laboratory 




.30 




221 


Writing essays, themes, or stories 




.33 




219 


Having individualized instruction 




.19 






Using teaching machines or computer-assisted instruction 




.05 




229 


Extent to which disciplinary matters are problems in your school (often happens, sometimes happens, never happens): 




Stllfi^nrc finn't atr^nH crhnni 


.JO 




Z3D 


— 


^tiiH^ntc put rl£)cc#kc t*\jt*n iF thf>v att#*nH crKtnnl 


.Jo 






— 


StLid^nt^k talk hark tn t^arhprc 


.Zj 






— 


Students refuse to obey instructions 


.19 




263 




Students get in fights with each other 


.30 




261 


— 


Students attack or threaten to attack teachers 


.18 




263 


— 


Rules that are enforced in your school: 










School grounds closed to students at lunch time 


.38 




276 


— 


Students responsible to the school for property damage 


.26 




276 


— 


Hall passes required 


.43 




276 


— 


**No smoking" rules 


.36 




276 


— 


Rules about student dress 


.54 




276 


— 


School ratings (poor, fair^ don't know, good, excellent); 










Condition of buildings and classrooms 


.39 


.52 


259 


225 


Library facilities 


.29 


.39 


257 


224 


Quality of academic instruction 


.20 


.32 


257 


219 


Reputation in the community 


.23 


.44 


252 


221 


Teacher interest in students 


.23 


.35 


254 


221 


Effective discipline 


.2! 


.26 


252 


221 


Fairness of discipline 


.21 


.24 


253 


221 


School spirit 


.31 


.38 


257 


221 



High school has minimum competency or proficiency test— a special test that must be passed to get a H.S. diploma 
(yes, donU know, no) .45 .68 256 

How much has each of the following interfered with your education at this school? (not at all, somewhat, a great deal): 



Courses arc too hard — 

Find it hard to adjust to school routine — 

Poor teaching -- 

Poor study habits — 

Courses arc too easy — 

How many of the students in your class were black? (none, few, about half, most, all); 

In first grade .76 

In sixth grade .68 

In ninth grade .75 

How many of the students in your class were Hispanic? (none, few» about half, most, all): 

In first grade .58 

In sixth grade .63 

In ninth grade .67 



No. of school changes due to family moving 
When began attending this school 
Kindergarten attendance 



.77 



.93 



.23 
.14 
.24 

.18 
.22 



.71 

.81 
.83 



.70 
.68 
.75 

.89 



222 
220 
221 



213 
209 
21) 

263 



272 



225 



225 
223 
222 
225 
223 



204 
\^ 
198 



201 
1^1 
193 



230 
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Ihelr parents to questionnaire items about high school gnides, expectations, and attitudes, by selected 
student characteristics and sex of parent questionnaire resnondent 



Vanahle 



Cohort 



I. High school grade average 



Sophomore 
Senior 



All 
siudenls 



.75 
.76 



S<?x 



.Male I Female 



Race/eihnicUv 



.75 
.73 



.77 
.76 



White 1 Hispanic 1 BlaLT 



.79 
.77 



.67 
.69 



.62 
.70 



Test score quanile 



.59 
.56 



.6H 
.70 



.75 
.74 



SLS composue 
Med 



Low 



High 



.7H 
.79 



.69 
.69 



.77 
.76 



.Kl 

.82 



Respondent 



Mother | Father 



.74 
.74 



.80 
.77 



3.524 
3.234 



2. Parental mlluencc on posi high school plans 



a. Mother's mlluence 

b. Father's innuencc 

3. Age «udeni expects to 

a. Marry 

b. Have first child 
c- Stan regular lob 
d. I jve in own home 

e Finish tull time ediKJium 



Senior 
Senior 



Sophomore 

Senior 
Sophomore 

Senior 
Sophomore 

Senior 
Sophomore 

Senior 
Sophomore 

Senior 



4. CXcupational expectations. Jge 3(H Sophomore 

Senior 



.21 



.42 
.57 
.39 
.51 
.32 
.48 
.27 
.40 
.43 
M 

.31 
.37 



.18 
.18 



.32 
.45 
.28 
.36 
.36 
.47 
.21 
.28 
.44 
.46 

.34 
.34 



.18 
.24 



.47 
.60 
.46 
.58 
.29 
.46 
.34 
.50 
.43 
.49 

.27 
.38 



.18 

.22 



.44 

.58 
.40 
.50 
.34 
.51 
.27 
.43 
.47 
.50 

.32 
.40 



.23 
.19 



.39 
.58 
.23 
.53 
.28 
.46 
.33 
.46 
.39 
.44 

.38 
38 



.19 
.21 



.31 
.40 
.52 
51 
.21 
.36 
.12 
.23 
.25 
.37 

.31 
.37 



.17 
.14 



.33 
..S4 
.30 
.51 
.18 
.34 
.30 
.37 
.29 
.44 

.30 
.35 



.18 
.24 



.44 
.58 
.34 
.47 
.30 
.46 
.29 
.41 
.44 
.42 

.34 
.38 



.19 
.18 



.40 
.52 
.36 
.48 
.25 
.42 
.30 
.36 
.41 
.45 

.34 
.40 



.15 
.25 



.44 
.53 
.43 
.44 
.33 
.45 
.19 
.42 
.46 
.49 

.33 
.43 



.16 
.18 



.42 
.62 
.38 
.59 
.22 
.38 
.31 
.40 
36 
.47 

.32 
.36 



.18 
.20 



.42 
.52 
.37 
.44 
.32 
.46 
.28 
.40 
.46 
.46 

.32 
.39 



.15 
.16 



.34 
.49 
.28 
.38 
33 
.44 
.21 
.29 
.36 
.40 

.36 
.39 



19 
.24 



.42 
.56 
.40 
..SO 
.32 
.47 
.29 
.38 
.44 
.47 

.31 
.37 



.18 
.18 



.41 
.55 
.38 
.50 
.33 
.49 
.25 
.43 
.41 
.49 

.34 
.39 



2.819 
2.353 



2.278 
2.118 
2.038 
1.797 
2.753 
2.617 
2.529 
2.373 
2.385 
2,335 

3.041 
2,968 



5. College expectations when child wa.s in 



a. Grade 6 or 7 

b. Cirade 8 or 9 
Grade 8 or 9 

c. Cirade 10 

d. Grade II 

6. Mother's aspirations loi diild* 
education*" 



Sophomore 
Sophomore 
Senior 
Senior 
Senioi 



Sophomore 
Senior 



.43 
.45 
.40 
.42 
.46 



.57 
.59 



44 

.46 
.40 
.46 
.51 



59 
.60 



.42 
43 
.40 
.39 
.41 



.56 
.*i9 



.46 
.49 
.44 
47 
.50 



.60 
.64 



.38 
.31 
.35 
.28 
.32 



.SI 



.2S 
.19 
.21 
.13 
.30 



.36 
.41 
.31 
.29 
41 



.36 
.38 
.30 
.40 
.46 



.32 
.38 
.36 
.42 
.46 



.29 
.41 
.30 
.28 
.29 



.41 
.43 
.34 
.41 
.43 



38 
.44 
.38 
.4) 
.49 



23 
.31 
27 
.23 
.2S 



.4S 47 .54 .51 51 .49 .58 47 
.40 46 55 -60 .58 .52 56 



.44 
.46 
.40 
.39 
.44 



S7 
.59 



.41 
.42 
.41 
.45 
.50 



2.188 
2.625 
2,212 
2.203 
2.404 



1.59S 
1.556 



7. Student's ability lo complete 
college 



Si)phiimore 
Senior 



.40 
42 



42 

.44 



.37 
.39 



.44 
.44 



.31 
.34 



2^ 30 29 .30 .34 38 .36 32 
.32 .31 .40 .24 .18 .39 .41 U 



^9 
4S 



.41 2.983 
.45 2.983 



8. Sex role aimudes 

a. Working mother is gtnid mother Sophomore 

b. Male shimld be the 

achiever S<iphomore 

c. Women happiest making 

a home S^^yhcnwrt: 



18 


16 


19 


18 


18 


05 


n 


14 


.19 


21 


17 


.16 


2<^ 


19 


12 


3.140 


21 


20 


.20 


25 


19 


.08 


14 


18 


25 


26 


..9 


.19 




.24 


.16 


3.097 


18 


IS 


.19 


17 


18 


12 


.09 


.13 


\2 


21 


.10 


14 


22 


.18 


16 


3.027 



'The slaiiMic em.iloyctl i.. ineasurc ^^msl^u•lKy l^ C ramer s V 

hlndudcs only those .as^s ^.herc the mother an^^.crcd ihe Parent (;.K-Mionnaire 
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Table A.8. Relative bias between parent and chiM (1980 sophomores and seniors) responses to questionnaire 
items about grades, plans, and attitudes* 



Variable 


Sophomores 


Seniors 


Child 


Parent 


Child 


Parent 


Grades in high school: 










Mostly A's (90- 100) 


10.8 


12.9 


12.5 


16.4 


A' or B + (85-89) 


18.1 


20.2 


22.5 


23.7 


Mostly B's (80-84) 


17.9 


17.0 


21.7 


19.2 


B- orC+ (75-79) 


28.2 


24.7 


25,5 


24.2 


Mostly Cs (70-74) 


13.7 


13.8 


12.6 


10.7 


Cor D+ (65-69) 


8.6 


3.2 


4.6 


5 0 


Mostly D's (60^) 


1.9 


2.2 


0.6 


0.7 


Mostiv Rtflnu; D 


0.8 


1.0 


0.0 


0.0 


Total 


ion n 


1 fv\ r\ 
lUU.U 


lOU.U 


100.0 


Mother's influence on child's plans after high school: 










Not at all 






11.4 




Somewhat 






44.6 


41.8 


A ereat H^nl 




— . 


44.1 


44.4 


loial 








100. u 


Father's influence on child's plans after high school: 










Not at all 






14.1 


16.0 


Somewhat 






45.8 


46.1 


A great deal 






40.1 


37.9 


Total 






lOU.U 


100.0 


Age child expects (is expected) (o get married: 










Have already done this 


0.3 


0.6 


1.3 


3.7 


20 or under 


21.7 


15.8 


19.2 


13.7 


21 to 24 


50.6 








25 or more 


27.4 


32.9 


28.0 


31.6 


Total 


lOU.U 


100.0 


100.0 


100.0 


Age child expects (is expected) to have first child: 










Have already done this 


0.6 


0.8 


1.8 


2.1 


20 or under 


7.4 


S.8 


6.3 


5.3 


21 to 24 


43.4 








25 or more 


48!6 


55.8 


54.3 


56.9 


Total 


100.0 


100.0 


100.0 


100.0 


Age child expects (is expected) to have first regular job: 










Have already done this 


9.3 


3.6 


16.0 


12.6 


19 or under 


56.8 


35.3 


36.1 


22.3 


20 to 22 


20.3 


40.0 


31.4 


41 .4 


23 or more 


13.6 


21.1 


16.5 


23!7 


Total 


100.0 


lOU.U 


100.0 


100.0 


Age child expects (is expected) to live in own home or apartment: 








Have already done thi'; 


0.6 


0.8 


2.2 


5.4 


20 or under 


66.1 


37.8 


49.0 


29.4 


21 to 24 


27.5 


50.0 


42.8 


54.0 


25 or more 


5.8 


11.4 


6.0 


11.2 


Total 


100.0 


100.0 


100.0 


100.0 


Age child ex()ects (is expected) to finish fuUtimc education: 








Have already done this 


17.9 


0.1 


1.4 


5.2 


20 or under 


54.0 


28.7 


31.6 


18.1 


21 to 24 


23.9 


60.6 


57.0 


64.4 


25 or more 


4.2 


10.6 


10.0 


12.3 


Total 


100.0 


100.0 


100.0 


100.0 
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Table A.8. (continued) Relative blu between parent and child (1980 wphomores and senior*) responses to 
questionnaire Items about grades, plans, and attitudes" 



Variable 



Child 



Sophomorei 

I 



Parcnl 



Child 



Seniors 

ZIZ 



Parent 



Child's expected occupation when 30 years old: 
Clerical 
Craftsman 
Farmer 
Homemaker 
Laborer 
Manager 
Military 
Operative 

Professional, advanced degree 
Professional, other 
Proprietor or owner 
Protective service 
Sales 

School teacher, elementary or sec. 

Service 

Technical 

Not working 

Total 

Child expected to go to college when in earlier grades (pet 
6th or 7th grade 
8th or 9th grade 
lOth grade 
Uih grade 

Mother's educational desires for child:* 
Less than H.S. graduation 
High school graduation only 
Vocational, trade, or business school: 

Less than two years 

Two years or more 
College program 

Less than two years 

Two or more years 

Finish 4- or 5-ytdr program 

Master's degree 
Ph.D.. M.D., or equivalent 

Total 

Abuity to complete college: 
Yes, definitely 
Yes, probably 

No, probably not (not sure) 
No, definitely not 

Total 



9,1 
8.6 
2.8 
5.3 
2.1 
3.8 
3.4 
3.1 
24.4 
13.2 
2.9 
1.8 
1.9 
2.7 
4.2 
8.2 
2.6 

100.0 



11.2 
10.0 
1.6 
5.6 
1.9 
5.6 
2.9 
2.7 
24.8 
10.4 
2.6 
1.4 
1.9 
4.5 
3.9 
8.5 
0.5 



10.6 
7.1 
1.6 
2.9 
2.0 
7.1 
2.2 
2.9 
26.5 
13.3 
3.5 
1.8 
1.9 
3.8 
3.6 
8.1 
1.2 



••yes") 



66.4 
74.7 



0.5 
164 

3.8 
9.2 

1.6 
11.0 
32.5 

9.2 
15.7 

100.0 

39.0 
34.8 
22.9 
3.3 

lOO.O 



A working mother of pre-schooi children can be just as good a mother as the woman who doc»n*t 
Agree strongly 3^'] 

29:0 30.2 

Disagree 14 9 

Disagree strongly ' 



work: 



Total 



100.0 



100.0 



1? is usually better for everyone involved if the man is the achiever outside the home and the 

woman takes care of the home and family: 

Agree strongly }}*^ 

38> 1 

38.0 

12.3 



Agree 
Disagree 

Disagree strongly 



20.0 
34.8 
34.9 

10.3 



100.0 



Total 

Most women are happiest when they are making a home and caring for children: 
Agree strongly l^*^ 

43.4 
7.8 



100.0 



Agree 
Disagree 

Disagree strongly 




Total 



100.0 



100.0 



Note Details may not add lo iotal< due to rounding. 

aaa-Kd on only those cases where the mother answered the parent questionnaire. 



10.8 
7.2 
1.2 
5.8 
2.1 
9.1 
2.3 
2.7 

25.2 
9.9 
3.3 
1.7 
3.2 
4.1 
2.6 
8.3 
0.5 



100.0 


100.0 


100.0 


'^5.1 






69.0 


71.4 


67.5 




73.6 


67.9 




77.0 


71.3 


0.4 


0.6 


0.1 


7.5 


11.7 


5.9 


10.4 


4.6 


11.8 


9.6 


11.4 


8.8 


8.7 


2.4 


7.1 


8.3 


11.0 


8.6 


34.4 


33.9 


34.6 


10.4 


9.5 


13.0 


10.4 


14.7 


10.1 


100.0 


100.0 


100.0 


58.0 


49.4 


64.1 


30.4 


32.8 


27.2 


8.6 


16.0 


6.5 


2.9 


1.9 


2.2 


100.0 


100.0 


100.0 
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Table A.9. I<:stiinate$ of coefficients of consistency between responses of 1980 sophomores and seniors and those of 
their parents to questionnaire items about financial matters and college choice factors, by selected 
student characteristics and sex of parent questionnaire respondent 



Variable 


Cohort 


All 
students 


Sex 


Race/ethnicity 


Test score quartile 


SES composite 


Respondent 


n 


Male 1 Female 


White 1 Hispanic 


1 Black 


1 


2 


3 

I — 


4 

— J 


Low 


1 Med. 1 High 


Mother 


Father 


!. Schooling cxpcnse\, Scpl '80— 




































Aug. '81 


Senior 


.61 


.60 


.61 


.66 


.41 


.41 


.43 


-53 


.58 


.62 


.56 


.55 


.59 


.57 


.64 


2.789 


2. Living expenses, Sept. '80 — 




































Aug. '81 


Senior 


.22 


.20 


.24 


.25 


.11 


.11 


.07 


.22 


.30 


.33 


.17 


.21 


.33 


.20 


.26 


2.790 


3. Payment for livmg and schiH)! expenses from 




































Senior 


.47 


.42 


.51 


.50 


.20 


.43 


.25 


.37 


-46 


-57 


.23 


.38 


.47 


-45 


.47 


2,428 


b. Spouse 


Senior 


.12 


.04 


.18 


.14 


.22 


.01 


.02 


.26 


.16 


-.01 


.16 


.13 


.04 


.08 


.17 


1.924 


c. Other relative 


Senior 


I A 


.18 


.15 


.19 


.06 


.09 


.12 


.25 


.28 


.13 


.09 


-17 


.21 


.11 


.28 


1 964 


d. Summer earnmgs ('80) 


Senior 


.18 


.16 


.18 


.20 


.16 


-.01 


.12 


.13 


.18 


.29 


.11 


.19 


.26 


.14 


.26 


2.243 


c. F.arnmg\ Sept. 80-- 




































Aug. '81 


Senior 


.27 


.26 


.27 


.29 


.17 


.12 


.13 


.27 


-30 


.32 


-18 


.28 


.34 


.22 


.33 


2.021 


f. Savmgs 


Senior 


.17 


.20 


.17 


.19 


.13 


.20 


.1 1 


-15 


.15 


.32 


.13 


.15 


.28 


.17 


.20 


1.958 


g. State scholarship or grant 


Senior 




.26 


.39 


.36 


.23 


.17 


.23 


.29 


.39 


.39 


.36 


.30 


.29 


.31 


.35 


2J05 


h. Federal scholarship or gram 


Senior 


.}} 


.32 


..36 


.32 


.35 


.29 


-30 


.31 


.39 


.33 


-35 


-32 


.30 


.35 


.27 


2.012 


i. Other scholarship or gram 


Senioi 


M 


.39 


.37 


.42 


.38 


.21 


.17 


.25 


.36 


.48 


.26 


.40 


.48 


.34 


.43 


2,046 


j. State loan 


Senior 


.17 


.12 


.23 


22 


.CW 


.05 


.05 


-.01 


.28 


.27 


.08 


.18 


.23 


-12 


.25 


2.010 


k. Federal loan 


.Senior 


It) 


.18 


.14 


.20 


.18 


.02 


.05 


.13 


.20 


.22 


-09 


.18 


.20 


.16 


.17 


2,020 


1. Other loan 


Senior 


07 


.06 


.09 


.08 


-.05 


.02 


• -U2 


.00 


.08 


.20 


-01 


.10 


.11 


-02 


.15 


2.004 


m. Social security or VA benefits 


Senu>r 


47 


.39 


.58 


.53 


.19 


34 


-24 


.47 


.57 


.70 


.39 


.51 


.56 


.45 


.47 


2,119 


Mean 




(.25) 


(.23) 


(.28) 


(.28) 


(.17) 


(.15) 


(.14) 


(.22) 


(29) 


(.32) 


(.19) 


(.25) 


(.29) 


(.22) 


(.29) 


— 


4. Estimated cost ol schooling* 




































a. Public }unio' or coiiimuiiit) 


Sophomore 


.14 


.12 


.16 


.17 


.45 


.03 


.14 


.04 


-12 


-25 


.04 


.16 


.20 


.15 


.13 


1,665 


college 


Senior 


.25 


.25 


2^ 


.24 


.25 


.35 


.20 


.22 


.33 


.25 


.20 


-25 


.31 


.23 


.29 


1.962 


b. State 4 yr college or university 


Sophomore 


.12 


.08 


17 


.15 


.05 


.10 


-15 


.10 


.18 


14 


.18 


12 


.14 


.14 


.11 


1.627 




Senior 


15 


.M 


.18 


.14 


.14 


.24 


-15 


.11 




.14 


.18 


. 14 


14 


.M 


.18 


1.890 


C. Private 4 yr college 


Sophomore 


n 


.10 


.14 


.14 


.02 


.07 


-21 


.01 


.0^ 


20 


. 14 


.06 


20 


. 1 4 


.08 


1.337 


or universi[> 


Senior 


0^> 


.08 


.04 


06 


02 


1^ 


-01 


02 


.1(1 


.10 


.06 


01 


09 


04 


.10 


1.600 


Mean 




( \'\} 


(.13) 


( 16) 


( 15) 


(.15) 


( 16) 


(14) 


(.08) 


(.16) 


( 18) 


( 13) 


( M) 


(18) 


(.14) 


(.15) 




5. Factors important m choosing a college' 


































a. Co liege expenses 


Sell! Of 


.:a 


19 


.27 


.25 


04 


n 


.04 


.14 


.26 


.^0 


M 


.16 


28 


.21 


.2^ 


1.702 


b. Availability ot tmancial uiJ 


Senior 


44 




M) 


43 


.24 


2S 


2^ 


.36 


.43 




26 


.38 


.14 


.44 


.42 


1.699 


c. Availability ot specilu courses 


Senior 


: I 


.12 


.11 


.12 


.01 


.17 


(V4 


1 1 


12 


12 


.02 


.10 


.19 


.11 


.12 


1.676 


d. Repuianon m academic areas 


Senior 


1^ 


14 


16 


.15 


.18 


.06 


10 


1^ 


M 


12 


17 


II 


14 


.16 


.14 


1,696 


e. Reputation in athletic program 


Senior 




M 


TS 




^2 


26 




2^ 


.24 


U 


\2 




31 


.31 


.32 


1.686 


t . Social lile ol college 


Senior 


IK 


.19 


.17 


16 


26 


08 


17 


M 


19 


17 


TS 


14 


.19 


.18 


.18 


1.681 


g. Able to live at horne aiui 




































attend college 


Senior 




M) 


N) 




M 


4*^ 


^7 


43 


SH 


60 


47 




.60 


.55 


59 


1.698 


Mean 




( 2^) 


( 27) 


(.29) 


(.29) 


(.20) 


( 2(0 


( 19) 


( 22) 


(.28) 


( U) 


( 2M 


( :m 


( 29) 


( 28) 


(.29) 





•Includes onls (hose t..ises v^here ilic sUideni thought he or she miglu .nieiul .i i)osist\oiidar> insltlu(i{>n .nul the sindeni's patent saui ihe siiuleiit w.is 



Table A.IO. ReliUve bias between parent and child (1980 gophomores and seniors) responses to 
questionnaire Items about ttnanclal matters and college choice factors. 




Money required by child for schooling expenses, Sept. 1980 - AugJ981: 

None _ 

Less lhan $500 _ 

$500 10 $999 _ 

$1,000 to $1,999 _ 

$2,000 to $4,000 _ 

More than $4,000 ^ 

Total 

Money required by child for living expenses next year: ^ 

None, live at home _ 
None, other reasons 

Less than $1,000 _ 

$1,000 to $1,999 _ 

$2,000 10 $2,999 __ 

$3,000 to $3,999 _ 

$4,000 to $4,999 _ 

$5,000 to $5,999 _ 

$6,000 to $10,000 _ 

More than $10,000 ^ 

Total 

To pay for living and school expenses from Sept. 1980 through Aug. 1981. child to 

some money from the sources): _ 

Parents _ 

Spouse _ 

Other relatives _ 

Summer earnings, 1980 _ 

Earnings, Sept. 1980-Aug. 1981 _ 

Savings _ 

Sia'.e scholarship or grant _ 

Federal scholarship or grant ^ 

Other scholarsl.'.p or grant _ 

State loan _ 

Federal loan _ 

Other loan _ 
Social Security or VA benehts 

Estimated schooling expenses at a public junior or community college: 

Under $500 i^'? 
$500 to $1,000 

$1,001 to $2,000 7 

$2,001 to $3,000 'Vs 

$3,001 10 $5,000 i'n 

S5 00. JO S7.000 3- 

Total 

Tstiniaied schooling expenses ai a state 4-year college or university: 

Under S500 l\ 

SSOOtoSl.OOO , , 

1 1,001 10 $2,000 ,A i 

S2.001 to $3,000 ,0 4 

$3,001 10 $5,000 Vi }. 

$5,0.,! .0 $7,000 ^ 
Total 

Estimated schooling expenses ai a private 4-year college or university : 
Under $500 

$500 to $1,000 ri 

$1,001 to $2,000 

$2,001 to $3,000 „-o 

S3.001 10 $5,000 il l 

$5 001 ,0 $7,000 jlH 

Total 

Factors important m choosing a college (pel. 'Wery important*') ^ 
College expenses 
Availability of financial aid 

Availability of specific courses _ 
Reputation in academic areas ^ 
Reputation in athletic programs 

Social life of the college _ 
Able to live at home and attend college 



Child 1 


rareni 


23.2 


27.7 


14.4 


10.8 


14.0 


17.5 


17.2 


18.1 




16.7 


11.0 


9.1 


inn n 


100.0 


22.6 


31.1 


4.1 


10.4 


1J.8 


9.7 


20.1 


15.5 


14.4 


16.6 


94 


8.8 


5.8 


4.1 


4.3 


2.8 


1.6 


0.8 


1.8 


0.3 


100.0 


100.0 



receive money from following sources (pet. reporting 



100,0 



11 1 


74.8 


10.2 


7.8 




8.0 


86,7 


62.2 


73.8 




"1 .0 




33.0 




26.0 




29.0 


1 k 0 

I 0 .w 


17.0 


K n 
o.u 


1 D.U 


1 1.0 


16.0 


6.0 


13.0 


10.0 


18.1 


18.7 


34.8 


39.6 


29.6 


28.0 


12.5 


9.8 


4.4 


3.3 


0.7 


0.5 


100.0 


100.0 


1.3 


1.9 


9.3 


11.4 


20.5 


28.3 


28.9 


29.2 


31.8 


21.4 


8.2 


7.7 


100.0 


100.0 


0.8 


0.4 


2.0 


1.5 


5.8 


6.0 


13.6 


13.8 


30.8 


32.9 


47.1 


45.4 


100.0 


lOO.O 


36.6 


.^2.5 


4().2 


43.6 


68.7 




52.8 


75.2 


10.7 


9.2 


28,1 


11.0 


2L7 


32.6 
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Tftble A.ll. Approximite sUindard errors of correlation coefflcients* 



Subgroup 


Sophomores 


Seniors 


r = 0 


r = .50 


r = .90 


r = 0 


r=.50 


r = .90 


Student-transcript comparisons: 














Total population 




- 


- 


.019 


.015 


.004 


Maie or leniaie siuaenis 


- 


- 


- 


.028 


.021 


.005 


test or dbo QUoruie suogroups 


- 


- 


- 


.042 


.032 


.008 


wnite students 


- 


- 


- 


.025 


.019 


.005 


DiacK siuQenis 




- 


- 


.053 


.043 


.010 


Hispanic students 


- 


- 


- 


.043 


.032 


.008 


Parent-child comparisons: 














Total population 


027 


020 








005 


^4ale or female students 




010 


008 




010 


OOR 


Test or SES quartile subgroups 


.055 


.041 


.011 


.055 


.041 


.011 


White students 


.032 


.024 


.006 


.033 


.025 


.006 


Black students 


.072 


.054 


.014 


.079 


.059 


.015 


fiispanic siuQcnia 


.Uo4 




.Ulo 




.Uoo 


.Ul / 


Female respondents (Parent 














Questionnaire) 


.034 


.026 


.006 


.036 


.027 


.007 


Male respondents (Parent 














Questionnaire) 


.045 


.034 


.009 


.045 


.034 


.009 


Twin/co-twin comparisons: 














Total population 


,094 


,071 


.018 


.102 


.077 


.015 



•The standard errors presented in the table were calculated from the formula var(r) = D(I - r2)2/(.8n), where r is the estimated correlation 
coefficient, D is a survey design adjustment factor, and n is the sample size (Kendall & Stewart, 1958). Conservative values of D were 
employed: 2.0 for parent-child and twin/co-twin comparisons and 4.0 for comparisons based on transcript data (Tourangeau et qL, in 
preparation). Sample sizes (Chapter 1) were reduced by 20 percent to adjust for cases not usable in the analysis due to item non-resppnse, 
**don*t know" replies, etc. 

The analysis for a few items was restricted to subsets of cases, viz., language in home, mother had job, mother's aspirations for child's 
education, estimated cost of school, and college choice factors. For the first item, the tabled siandard.^rrors should be doubled; for the 
remaining ones, they should be increased by 30 percent. 

To illustrate the use of table A. II. consider the estimated correlation coefficient of .87 between fep^ris of father's education level by 
sophomores and their parents (table 3.1). The standard error is found by linear interpolation between the values for r = .50 and 
rs .90 in table A. 11 to be approximately .005. 
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Table A.12, Approximate standard errors of bias estimates (percentage polnts)-parent as standard* 



Correlation 
coefficient 


Percentage (?) 


P = 50 


P = 20 ^or 80) 


P = 10 (or 90) 


0.2 


2.0 


1.6 


1.2 


0.4 


1.7 


1.4 


1.0 


0.6 


1.4 


1.1 


0.8 


0.8 


1.0 


0.8 


0.6 



•The size of the standard error is a lunciion ui inc tuuciauuu vi/ i/vit^w.. v....^ , — . „ . 

(P.) and parent (P2). Computation of standard errors were based on the equation Var(b) = Var(P,) + Var(P2) - 2cov(P,P2), where 
b = P V. When P, = Pi = P Var(b) = 2(1 - r)Var(P). Estimates were adjusted for item nonresponse, "don't know' responses, etc., 
by'redu'cing n by 20 Ucent a;.d for survey design effect by increasing the simple random sampling estimates by 40 percent. The 
standard error estimates may be used for either cohort. 

The analysis for a few items was restricted to subsets of cases, viz., language in home, mother had job. mother's asp|rat,ons for child s 
educaSon. estimated cost of school, and college choice factors. For the first item, the tabled standard errors should be doubled; for the 
remaining ones, they should be increased by 30 percent. 

To illustrate the use of Table A.12, consider the estimated bias in the variable "home has 50 or more books.*' The estimated bias is 4 
^r ntTp^^^^ 85 percent 'of the parents and 81 percent of their children replied "yes;" and the coefficient of correlation 
between child and parent responses is .35. (See tables A.2 and A.3) Thus the standard error of the bias estimate from table A. 12 is 
about 1.4 percentage points and the bias differs from zero by 2.9 standard errors (4/1.4 = 2.9). 
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T*hk A Approximtte sttndird errori^ of ¥m esUmtites— transcript as standard* 



SubarouD 


Grade 

average 

(letters) 


Amount of 
coursework 
(semesters) 


All students 


.10 


.028 


Males, females 


.12 


.035 


Test quartile 


.15 


.052 


SES quartile 


.16 


.050 


White stuoents 


.11 


.032 


Black students 


.25 


.059 


Hispanic students 


.20 


.062 



'"Balanced repeated replicates" estimates of standard errors were calculated for each bias value. This table shows the mean of the 
standard error values for the four coursework areas. 
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